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Preface 


It has long been the established policy of CRC Press to publish, in handbook form, 
the most up-to-date, authoritative, logically arranged, and readily usable reference 
material available. 

Just as pocket calculators have replaced tables of square roots and trig functions; 
the internet has made printed tabulation of many tables and formulas unnecessary. 
As the content and capabilities of the internet continue to grow, the content of this 
book also evolves. For this edition of Standard Mathematical Tables and Formulae 
the content was reconsidered and reviewed. The criteria for inclusion in this edition 
includes: 


e information that is immediately useful as a reference (e.g., interpretation of 
powers of 10); 


e information that is useful and not commonly known (e.g., proof methods); 


e information that is more complete or concise than that which can be easily 
found on the internet (e.g., table of conformal mappings); 


e information difficult to find on the internet due to the challenges of entering an 
appropriate query (e.g., integral tables). 


Applying these criteria, practitioners from mathematics, engineering, and the sci- 
ences have made changes in several sections and have added new material. 


e The “Mathematical Formulas from the Sciences” chapter now includes topics 
from biology, chemistry, and radar. 


e Material has been augmented in many areas, including: acceptance sampling, 
card games, lattices, and set operations. 


e New material has been added on the following topics: continuous wavelet trans- 
form, contour integration, coupled analogues, financial options, fractal arith- 
metic, generating functions, linear temporal logic, matrix pseudospectra, max 
plus algebra, proof methods, and two dimensional integrals. 


e Descriptions of new functions have been added: Lambert, prolate spheroidal, 
and Weierstrass. 


Of course, the same successful format which has characterized earlier editions of the 
Handbook has been retained. Material is presented in a multi-sectional format, with 
each section containing a valuable collection of fundamental reference material— 
tabular and expository. 


xi 


xii Preface 


In line with the established policy of CRC Press, the Handbook will be updated 
in as current and timely manner as is possible. Suggestions for the inclusion of new 
material in subsequent editions and comments regarding the present edition are wel- 
comed. The home page for this book, which will include errata, will be maintained 
at http: //www.mathtable.com/smtf. 

This new edition of the Handbook will continue to support the needs of practi- 
tioners of mathematics in the mathematical and scientific fields, as it has for almost 
90 years. Even as the internet becomes more powerful, it is this editor’s opinion that 
the new edition will continue to be a valued reference. 


MATLAB® is a registered trademark of The MathWorks, Inc. 
For product information please contact: 

The MathWorks, Inc. 

3 Apple Hill Drive 

Natick, MA, 01760-2098 USA 

Tel: 508-647-7000 

Fax: 508-647-7001 

E-mail: info@mathworks.com 

Web: www.mathworks.com 


Every book takes time and care. This book would not have been possible without the 
loving support of my wife, Janet Taylor, and my son, Kent Zwillinger. 


May 2017 
Daniel Zwillinger 
ZwillingerBooks@gmail.com 
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Geometric Series 











—Rick Mabry 


Addition Formulae for the Sine 
and Cosine 


sinxsiny 


AUISXSOO 


Oa! 


ASOOXUIS 


lia 


COSXCOSY 


sin(x + y) = sinxcosy + cosxsiny 
cos(x + y) = cosxcosy — sinxsiny 


Geometric Series 
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—Benjamin G. Klein 
and Irl C. Bivens 


The Distance Between a Point and a Line 


y 


(a,ma + c) 


|ma+e—b| 


y=mxtc 


d _|mat+c-—b| 


1 Vl +m? 


—R. L. Eisenman 
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The Arithmetic Mean-Geometric Mean The Mediant Property 
Inequalit 
q y aoc _. a_a +c af 
b d b btd ad 


ab>0= > lab 





=< a-»< b a 





—Charles D. Gallant —Richard A. Gibbs 


Reprinted from “Proofs Without Words: Exercises in Visual Thinking,’ by 
Roger B. Nelsen, 1997, MAA, pages: 3, 40, 49, 60, 70, 72, 115, 120. Copyright 
The Mathematical Association of America. All rights reserved. 

Reprinted from “Proofs Without Words II: More Exercises in Visual Thinking,” 
by Roger B. Nelsen, 2001, MAA, pages 46, 111. Copyright The Mathematical As- 
sociation of America. All rights reserved. 





1.2 CONSTANTS 


1.2.1. DIVISIBILITY TESTS 


. Divisibility by 2: the last digit is divisible by 2 
. Divisibility by 3: the sum of the digits is divisible by 3 
. Divisibility by 4: the number formed from the last 2 digits is divisible by 4 
. Divisibility by 5: the last digit is either 0 or 5 
. Divisibility by 6: is divisible by both 2 and 3 
. Divisibility by 9: the sum of the digits is divisible by 9 
. Divisibility by 10: the last digit is 0 
. Divisibility by 11: the difference between the sum of the odd digits and the 
sum of the even digits is divisible by 11 
EXAMPLE Consider the number N = 1036728. 
e The last digit is 8, so N is divisible by 2. 
e The last two digits are 28 which is divisible by 4, so N is divisible by 4. 
e The sum of the digits is 27 =1+0+3+6+7+2-+8. This is divisible by 3, so N 
is divisible by 3. This is also divisible by 9, so N is divisible by 9. 
e The sum of the odd digits is 19 = 1+3-+ 7+ 8 and the sum of the even digits is 
8 = 6 + 2; the difference is 19 — 8 = 11. This is divisible by 11, so N is divisible 
by 11. 
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1.2.2 DECIMAL MULTIPLES AND PREFIXES 


The prefix names and symbols below are taken from Conference Générale des Poids 
et Mesures, 1991. The common names are for the United States. 


Symbol 


19(10"") googolplex 
ig? googol 
10" heptillion 
107! hexillion 
1 000 000 000 000 000 000 = 1018 quintillion 
1 000 000 000 000 000 = 101° quadrillion 
1 000 000 000 000 = 10” trillion 
1.000 000 000 = 10° billion 
1 000 000 = 10° million 
1 000 = 10° thousand 
100 = 10? hundred 
10 = 10! ten 
0.1=107! tenth 
0.01 =107? hundredth 
0.001 = 1073 thousandth 
0.000 001 = 10~® millionth 
0.000 000 001 = 10-9 billionth 
0.000 000 000 001 = 107-1? trillionth 
0.000 000 000 000 001 =10-!° quadrillionth 
0.000 000 000 000 000 001 = 10718 quintillionth 
10-2! hexillionth 
1o-=* heptillionth 


< NP MBOBERCAHRaMmAZSONHUMNK 





1.2.3 BINARY PREFIXES 
A byte is 8 bits. A kibibyte is 219 = 1024 bytes. Other prefixes for power of 2 are: 


Factor Prefix Symbol 
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1.2.4 INTERPRETATIONS OF POWERS OF 10 


191 
1918 
1014 
1915 
1916 
1017 
1918 
1919 
1021 
1024 
1925 
193° 
19°° 
10°? 
109°4 
10%8 


Planck time in seconds 

Planck length in meters 

mass of an electron in kilograms 

mass of a proton in kilograms 

the radius of the hydrogen nucleus (a proton) in meters 
the likelihood of being dealt 13 top honors in bridge 
the (Bohr) radius of a hydrogen atom in meters 

the number of seconds it takes light to travel one foot 
the likelihood of being dealt a royal flush in poker 

the density of water is | gram per milliliter 

the number of fingers that people have 

the number of stable elements in the periodic table 

the speed of the Earth around the sun in meters/second 
the number of hairs on a human scalp 

the number of words in the English language 

the number of seconds in a year 

the speed of light in meters per second 

the number of heartbeats in a lifetime for most mammals 
the number of people on the earth 

the distance from the Earth to the sun in meters 
diameter of the solar system in meters 

number of cells in the human body 

the surface area of the earth in square meters 

the number of meters light travels in one year 

the age of the universe in seconds 

the volume of water in the earth’s oceans in cubic meters 
the number of possible positions of Rubik’s cube 

the volume of the earth in cubic meters 

the number of grains of sand in the Sahara desert 

the mass of the earth in kilograms 

the mass of the sun in kilograms 

the number of atoms in the earth 

the mass of the observable universe in kilograms 

the number of elements in the monster group 

the volume of the universe in cubic meters 


(Note: these numbers have been rounded to the nearest power of ten.) 


1.2.5 


1.2.6 
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NUMERALS IN DIFFERENT LANGUAGES 





0 





Arabic 





Bengali 





Chinese (simple) 





Chinese (complex) 





Devanagari 
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Ge’ez (Ethiopic) 





Gujarati 





Gurmukhi numbers 





Kannada 





Khmer 





Lao 





Limbu 





Malayalam 





Mongolian 





Myanmar 





Odia 
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Tamil 





Telugu 





Thai 








Urdu 
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ROMAN NUMERALS 


The major symbols in Roman numerals are I 








1,V 


5, X= 10,L = 50, C = 100, 
D = 500, and M = 1,000. The rules for constructing Roman numerals are: 
1. A symbol following one of equal or greater value adds its value. (For example, 


Il = 2, XI = 11, and DV = 505.) 
A symbol following one of lesser value has the lesser value subtracted from 
the larger value. An I is only allowed to precede a V or an X, an X is only 
allowed to precede an L or a C, and a C is only allowed to precede a D or 
an M. (For example IV = 4, IX = 9, and XL = 40.) 


. When a symbol stands between two of greater value, its value is subtracted 


from the second and the result is added to the first. (For example, XIV= 
10+(5—1) = 14, CIX= 100+(10—1) = 109, DXL= 500+(50—10) = 540.) 


. When two ways exist for representing a number, the one in which the symbol 


of larger value occurs earlier in the string is preferred. (For example, 14 is 
represented as XIV, not as VIX.) 


Decimal number 1 
Roman numeral I 


10 14 50 200 400 500 600 


2 


Il 


3 4 5 
I IV Vv 


X XIV L CC CD D- DC CMXCIx M 


1995 1999 


2000 2001 


MCMXCV MCMXCIX MM MMI 


6 7 8 9 
VI VU VI Ix 
999 1000 
2017 2018 
MMXVILT MMXVIII 
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1.2.7. TYPES OF NUMBERS 


1. Naturalnumbers The set of natural numbers, {0,1,2,...}, is customarily 
denoted by N. Many authors do not consider 0 to be a natural number. 











2. Integers — The set of integers, {0, +1, +2,...}, is customarily denoted by Z. 





3. Rational numbers The set of rational numbers, 17 | p,q € Z,q £ O}, is 
customarily denoted by Q. 


(a) Two fractions : and = are equal if and only if ps = qr. 
(b) Addition of fractions is defined by 7 +f= cera 
(c) Multiplication of fractions is defined by : CaP, 


4. Real numbers _ Real numbers are defined to be converging sequences of 
rational numbers or as decimals that might or might not repeat. The set of real 
numbers is customarily denoted by R. 


Real numbers can be divided into two subsets. One subset, the algebraic num- 
bers, are real numbers which solve a polynomial equation in one variable with 
integer coefficients. For example; \/2 is an algebraic number because it solves 
the polynomial equation x? — 2 = 0; and all rational numbers are algebraic. 
Real numbers that are not algebraic numbers are called transcendental num- 
bers. Examples of transcendental numbers include 7 and e. 


5. Definition of infinity The real numbers are extended to R by the inclusion 
of +00 and —oo with the following definitions 

















(a) forxinR: -co<2%<o (ec) ifa >Othenx-co=co 
(b) forzvinR: x+c=0co (f) ifa > Othena-(—oo) = —oo 
(c) forxinR: f-c=-c (g) cotom=co 

és r (h) —oo — co = —co 
(d) foravinR: — = — =0 (i) w-o=co 

ins Gj) 00+ (-00) = 00 


6. Complex numbers The set of complex numbers is customarily denoted 
by C. They are numbers of the form a + bi, where i? = —1, and a and b are 
real numbers. 


Operation computation 
addition t bi) +(c+di) (a+c)+i(b4+d) 
multiplication + bi)(c + di) (ac — bd) + (ad + bc)i 





reciprocal 


a+ bi 
complex conjugate z=a 4 
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1.2.8 REPRESENTATION OF NUMBERS 


Numerals as usually written have radix or base 10, so the numeral a@ndn—1...@1a0 
represents the number a,10” + an—110"—1 +--+ + a210? + a, 10 + ap. However, 
other bases can be used, particularly bases 2, 8, and 16. When a number is written in 
base 2, the number is said to be in binary notation. The names of other bases are: 


2 binary 6 senary 10 decimal 20 vigesimal 

3 ternary 7 septenary 11 undenary 60 sexagesimal 
4 quaternary 8 octal 12 duodecimal 

5 quinary 9  nonary 16 hexadecimal 


When writing a number in base b, the digits used range from 0 to b — 1. If 
b > 10, then the digit A stands for 10, B for 11, etc. When a base other than 10 is 
used, it is indicated by a subscript: 


10111lp =1x 24*+0x 2° 41x 2741x241 =23, 
A316 = 10 x 16+ 3 = 163, (1.2.1) 
5437 =5 x 7744x743 =276. 





To convert a number from base 10 to base b, divide the number by 6, and the 
remainder will be the last digit. Then divide the quotient by b, using the remainder 
as the previous digit. Continue this process until a quotient of 0 is obtained. 
EXAMPLE To convert 573 to base 12, divide 573 by 12, yielding a quotient of 47 and a 

remainder of 9; hence, “9” is the last digit. Divide 47 by 12, yielding a quotient of 3 and 


a remainder of 11 (which we represent with a “B’’). Divide 3 by 12 yielding a quotient 
of 0 and a remainder of 3. Therefore, 57310 = 3B912. 


Converting from base 6 to base r can be done by converting to and from base 
10. However, it is simple to convert from base b to base b”. For example, to con- 
vert 110111101, to base 16, group the digits in fours (because 16 is 2*), yielding 
1 1011 1101, and then convert each group of 4 to base 16 directly, yielding 1BD16. 


1.2.9 REPRESENTATION OF COMPLEX NUMBERS — 
DEMOIVRE’S THEOREM 


A complex number a + bi can be written in the form re’”, where r? = a? + b? and 
tan 0 = b/a. Because e*” = cos@ + isin#6, 


(a + bi)” = r"(cosné + isinné), 


2k 2k 
V1 = cos— + isin —, k=0,1,...,n—1. (1.2.2) 
2k+1 2k+1 
ed LSP el Ce 
mr 
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1.2.10 ARROW NOTATION 


Arrow notation is used to represent large numbers. Start with m +n =m-m---m, 
— 


then (evaluation proceeds from the right) 


mitn=mtmto-tm mittn=mttmtt-ttm 
ee ———— 


For example, m tn =m", mt 2 =m"™, and m tt 3 =m"), 
1.2.11 ONES AND TWOS COMPLEMENT 


One’s and two’s complement are ways to represent numbers in a computer. For 
positive values the binary representation, the ones’ complement representation, and 
the twos’ complement representation are the same. 


e Ones’ complement represents integers from — (2N~! — 1) to 2N~1 — 1. For 
negative values, the binary representation of the absolute value is obtained, and 
then all of the bits are inverted (i.e., swapping 0’s for 1’s and vice versa). 

e Twos’ complement represents integers from —2'—! to 2%—1 — 1. For negative 
vales, the two’s complement representation is the same as the value one added 
to the ones’ complement representation. 


nm 
Psi 10 


| 
| | 
| 
| 8 | 
| 2 
| 
| 
z= ee eee eee 
= | pT 
| 2 | 
LB 
| 4 | 
| 5 | 
pas =e 


5 
4 
3 
2 
1 
—1 
—2 
—3 
—4 
—5 





1.2.12 SYMMETRIC BASE THREE REPRESENTATION 

In the symmetric base three representation, powers of 3 are added and subtracted 
to represent numbers; the symbols {{,0,t} represent {—1,0, 1}. For example, one 
writes t\| for 5 since 5 = 9—3-—1. To negate a number in symmetric base three, turn 
its symbol upside down, e.g., —5 =|. Basic arithmetic operations are especially 
simple in this base. 
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1.2.13 HEXADECIMAL ADDITION AND SUBTRACTION TABLE 


A= 10:B=11,C=12,D=13, B= 14,F= 15. 
Example: 6 + 2 = 8; hence 8 — 6 = 2 and 8 — 2 =6. 
Example: 4+ E = 12; hence 12 —-4=Eand12—-E=4. 


4 5 6 7 8 9 A B C D E F 











07 08 09 OA OB OC OD OE OF 
06 07 08 09 OA OB OC OD OE OF 10 Il 12 #13 «#14 
07 08 09 OA OB OC OD OE OF 10 I1 12 #13 «14 «#15 


08 09 OA OB OC OD OE OF 10 11 12 #13 #14 #15 += 16 
12 13 14 15 16 17 


09 OA OB OC OD OE OF 10 Ii 

OB OC OD OE OF 10 11 12 13 #14 #15 #16 #17 «18 «#2419 

OE OF 10 11 12 #13 #14 #15 #16 «#17 «218~«19 «1A (1B «(1C 
LE 110 11 13 5 16 17 18 19 IA 1B 1C 1D IE 





1.2.14 HEXADECIMAL MULTIPLICATION TABLE 


Example: 2 x 4= 8. 
Example: 2 x F = 1E. 


12 3 4 5 6 7 8 9 A B C D E F 


O01 02 03 04 05 06 O07 O08 09 OA OB OC OD OE OF 


02 04 06 08 OA OC OE 10 12 14 16 18 IA 1C IE 
08 OC 10 14 #18 I1C 20 24 28 2C 30 34 38 3C 

5 OA OF 14 19 IE 23 28 2D 32 37 3C 41 46 4B 
12 18 IE 24 2A 30 36 3C 42 48 4E 54 5A 


07 OE 15 IC 23 2A 31 38 3F 46 4D 54 5B 62 69 
18 20 28 30 38 40 48 50 58 60 68 70 78 


08 10 
09 12 IB 24 2D 36 3F 48 51 SA 63 6C 75 TE 87 
OA 14 IE 28 32 3C 46 50 5A 64 6E 78 82 8C 96 


OB 16 21 2C 37 42 4D 58 63 6E 79 84 8F 9A AS 


OC 18 24 30 3C 48 54 60 6C 78 84 90 9C A8& B4 


OD 1A 27 34 41 4E 5B 68 75 82 8F 9C AX BO C3 


OE 1C 2A 38 46 54 62 70 TE 8C 9A A8 BO C4 D2 
OF 


1E 2D 3C 4B 5A 69 78 87 96 AS B4 C3 D2 El 


pol 


EG a i Dba all 
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1.3 SPECIAL NUMBERS 


1.3.1. POWERS OF 2 


0.5 

0.25 

0.125 

0.0625 

0.03125 

0.015625 

0.0078125 

0.00390625 

0.001953125 

0.0009765625 

0.00048828 125 

0.000244 140625 

0.0001220703125 

0.00006 103515625 

0.0000305 17578125 

0.0000152587890625 

0.00000762939453 125 

0.0000038 14697265625 

0.00000 19073486328 125 
1048576 | 0.0000009536743 1640625 
2097152 | 0.000000476837158203 125 
4194304 | 0.0000002384 185791015625 
8388608 | 0.0000001 1920928955078 125 
16777216 | 0.000000059604644775390625 
33554432 | 0.0000000298023223876953125 


he 
0.19999999999999999999. . .16 
0.028F5C28F5C28F5C28F5. . .16 
0.004189374BC6A7EF9DB2.. .1¢ 
0.00068DB8BAC710CB295E. . .16 
0.0000A7C5AC471B478423.. .16 
0.000010C6F7A0BS5ED8D36.. .16 
0.000001 AD7F29ABCAF485. . .16 
0.0000002AF31DC4611873...16 
9 | 3B9ACAO0 0.000000044B82FA09BSAS.. .16 
10 | 2540BE400 0.000000006DF37F675EF6. . .1¢ 








14 CHAPTER 1. NUMBERS AND ELEMENTARY MATHEMATICS 


1.3.3 SPECIAL CONSTANTS 
1.3.3.1 The constant z 


The transcendental number 7 is defined as the ratio of the circumference of a circle 
to the diameter. It is also the ratio of the area of a circle to the square of the radius 
(r) and appears in several formulas in geometry and trigonometry 


; ; 4 
circumference of a circle = 27r, volume of a sphere = 37 
area of a circle = mr’, surface area of a sphere = 4rr?. 


One method of computing 7: is to use the infinite series for the function tan~! « and 
one of the identities 


7 =4tan-'1=6 tan! 


1 


1 1 
=2tan 1 a +2 tan~ +8 tan! 5 2 tan! 
1 


; 239 (1.3.1) 
239 
1 1 1 
= 48 tan7! — + 32 tan7! — — 20 tan7! — 
an 18 + an 57 an 539 


1 
= 24 tan! 3 +8 tan! 57 +4 tan! 


There are many identities involving 7. For example: 


ee ee 
= < 16" 8i+1 8i4+4 B814+5 B46 


i= 






2+ (2+ 2+---+2+v2 














k—- 00 
k; square roots 
k square roots 
wx_—K—LLooVwI])e 
9 ow V2ty2+--+V24+v2 
Ped | 2 
k=1 
: —1)" 1 i i 
_ = ne i a i 
32. + Qn+1p 27° 125 343 


To 100 decimal places: 
m3. 14159 26535 89793 23846 26433 83279 50288 41971 69399 37510 
58209 74944 59230 78164 06286 20899 86280 34825 34211 70679 
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In different bases: 
m7 11.00100100001111110110101010001000100001011010001...2 
TY 3.11037552421026430215142306305056006701632112201...2 
T &Y 3.243F6A8885A308D313198A2E03707344A4093822299F. .. 16 


To 50 decimal places: 


1/8 % 0.39269 90816 98724 15480 78304 22909 93786 05246 46174 92189 
1/4 % 0.78539 81633 97448 30961 56608 45819 87572 10492 92349 84378 
1/3 = 1.04719 75511 96597 74615 42144 61093 16762 80657 23133 12504 
1/2 % 1.57079 63267 94896 61923 13216 91639 75144 20985 84699 68755 
Vim © 1.77245 38509 05516 02729 81674 83341 14518 27975 49456 12239 


In 2016 7 was computed to 12.1 trillion decimal digits. The frequency counts of the 
digits for 7 — 3, using | trillion decimal places, are: 


digit 0: 99999485134 digit 5: 99999671008 
digit 1: 99999945664 digit 6: 99999807503 
digit 2: 100000480057 digit 7: 99999818723 
digit 3: 99999787805 digit 8: 100000791469 
digit 4: 100000357857 digit 9: 99999854780 


1.3.3.2 The constant e 
The transcendental number e is the base of natural logarithms. It is given by 
; 1 nm co 1 
e= lim (1++) 2s (1.3.2) 


e & 2.71828 18284 59045 23536 02874 71352 66249 77572 47093 69995 
95749 66967 62772 40766 30353 54759 45713 82178 52516 64274 ... 


In different bases: 
e + 10.10110111111000010101000101100010100010101110110...5 
e © 2.55760521305053551246527734254200471723636166134...8 
e © 2.B7E151628AED2A6ABF7 158809CF4F3C762E7160F3...16 


co n 


The exponential function is e” = y —. Euler’s formula relates e and 7: e’ =—-1 
n! 


n=0 
1.3.3.3 The constant + 
Euler’s constant y is defined by 


; n 1 

y= lim (>: Z ~ be ") (1.3.3) 
k=1 

It is not known whether 7¥ is rational or irrational. 


y = 0.57721 56649 01532 86060 65120 90082 40243 10421 59335 93992 
35988 05767 23488 48677 26777 66467 09369 47063 29174 67495 ... 
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1.3.3.4 The constant ¢ 
@¢ —_ 1 


The golden ratio, @, is defined as the positive root of the equation | = — or 
¢? = o+1; thatis ¢ = dave There is the continued faction representation ¢ = [T] 
and the representation in square roots 


g=\14+14+V14+vi-e... 


@ & 1.61803 39887 49894 84820 45868 34365 63811 77203 09179 80576 ... 


1.3.4 FACTORIALS 


The factorial of n, denoted n!, is the product of all positive integers less than or equal 
ton; n! = n-(n—1)-(n—2)---2-1. By definition, 0! = 1. If n is a negative integer 
(n = —1,—2,...) then n! = +too. The generalization of the factorial function to 
non-integer arguments is the gamma function (see page 478); when n is an integer, 
T(n) = (n— 1). 

The double factorial of n is denoted by n!! and is defined as n!! = n(n — 2)(n — 
4)---, where the last term in the product is 2 or 1, depending on whether n is even 
or odd. The shifted factorial (also called Pochhammer’s symbol) is denoted by (a), 
and is defined as 





(a)y = a2 (a1) (042)--- (an = 1) = SER _ TE) (1.3.4) 


Approximations to n! for large n include Stirling’s formula (the first term of the 


m terms 








following) 
n\n+3 1 iL 
lw V2 (=) een ee 13. 
" re (+ aot set ) oe 
and Burnside’s formula 
n+ 7 a 
nl = V2Qr ( 2) (1.3.6) 
e 


Oo 


0.00000 | 1 0.00000 
0.00000 | 1 0.00000 
0.30103 | 2 0.30103 
0.77815 | 3 0.47712 
1.38021 | 8 0.90309 
2.07918 | 15 1.17609 
2.85733 | 48 1.68124 
3.70243 | 105 = 2.02119 
4.60552 | 384 = 2.58433 
3.6288 x 10° 5.55976 | 945 2.97543 
3.6288 x 10° 6.55976 | 3840 3.58433 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


eR 
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2.4329 x 1018 18.38612 | 3.7159 x 10° 9.57006 
2.6525 « 10° 32.42366 | 4.2850 x 101° 16.63195 
8.1592 x 1047 47.91165 | 2.5511 x 1024 24.40672 
3.0414 x 10%4 64.48307 | 5.2047 x 10°? 32.71640 
8.3210 x 108! 81.92017 | 2.8481 x 104! 41.45456 


1.1979 x 101°° = 100.07841 | 3.5504 x 10°° 50.55028 
7.1569 x 10148 = 118.85473 | 8.9711 x 10°9 59.95284 
1.4857 x 10188) 138.17194 | 4.2088 x 10° 69.62416 
9.3326 x 10157 —-157.97000 | 3.4243 x 107° 79.53457 
5.7134 x 10762 262.75689 | 9.3726 x 10'81 —_ 131.97186 
1.2201 x 101434 1134.0864 | 5.8490 x 10°67 —567.76709 
4.0239 x 107°” 2567.6046 | 3.9940 x 10/784 1284.6014 





1.3.5 BERNOULLI POLYNOMIALS AND NUMBERS 


The Bernoulli polynomials B,,(a) are defined by the generating function 
tet OS tn 
Ss x B,(«)—. (1.3.7) 


These polynomials can be defined recursively by Bo(x) = 1, Bi (x) = nBy_1(2), 
and J, B,(x) dx = 0 forn > 1. The identity By 41 (a +1) — Bei (x) = (k+1)x* 
means that sums of powers can be computed via Bernoulli polynomials 


rb — Brsi(n +1) — Beti(0) 


qeaok4... 
pe sapere eR kel 


(1.3.8) 
The Bernoulli numbers are the Bernoulli polynomials evaluated at 0: B, = B,,(0). 
er 


nl 





A generating function for the Bernoulli numbers is » By 


n=0 
following table each Bernoulli number is written as a fraction of integers: B, = 


Nn /Dn. Note that Bo,41 = 0 form > 1. 


t 
7 In the 
et — 


1.00000 x 10° 
(Qa = 1)/2 —5.00000 x 107! 


—2 
(22° ey 372 ee x) /2 —3.33333 x 10 


—2 
(30x+ = 60x2 ae 30x2 — 1)/30 2.38095 x 10 


—2 
(6x° =_ 1524 qe 1023 _ x)/6 —3.33333 x 10 
7.57576 x 1072 
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1.3.6 EULER POLYNOMIALS AND NUMBERS 


The Euler polynomials E,,(a) are defined by the generating function 


Co 


Qert ¢” 
Cl En —, i . 
eb +1 > (x) n! ee) 


n= 
Alternating sums of powers can be computed in terms of Euler polynomials 


i=l 








(1.3.10) 
The Euler numbers are defined as L,, = 2" En (5). A generating function is 





(1.3.11) 
Li — 2 
(403 — 62? + 1)/4 
ri —2e+ex 
(22° — 5at + 5a? — 1)/2 12 | 2702765 
1.3.7 FIBONACCI NUMBERS 
The Fibonacci numbers { F;, } are defined by the recurrence: 
fF, =1, fy =1, Pno2 = Fa + Fry. (1.3.12) 


An exact formula is available (see page 186): 


(45) S (55) | (1.3.13) 


Note that F7,, is the integer nearest to ¢”/ V5 as n — oo, where @ is the golden ratio. 











1346269 
2178309 
3524578 
5702887 
9227465 
14930352 
24157817 
39088169 
63245986 
832040 102334155 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


a 
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1.3.8 SUMS OF POWERS OF INTEGERS 


1. Define the sum of the first n k""-powers 


sp(n) = 1% + 2% 4...4n* = So mn (1.3.14) 
m=1 
(a) se(n) = (k + 1)~* [Bryi(n + 1) — Br+i(0)] 
(where the 5), are Bernoulli polynomials, see Section 1.3.5). 
(b) If sy(n) = 8*1 an®-™*?, then 


m=1 


k+1 : k+1 : 
SK41(N) = (5) a nk? a re sak agn* 


k+1 > 


(c) Note the specific values 








1 
si(n) =1424+34---+n=5n(n +1) 


























so(n) = 1? +2743? +-.+4n? = sn(n +1)(2n+1) 

s3(n) = 19 + 2° 43° +-..4n? = on2(n + 1)? = [si(n)]? 
sa(n) = 14 +24 434+-..+nt= 5(3n? + 3n — 1)s2(n) 

Pe ee ee r(n +1)2(2n? + 2n — 1) 


3. S “(km — 1)? = 5 [m?(n + 1)(2n + 1) — 6m(n +1) +6] 


4. S0(-1)* (km - 1) = al [2 — (2n + 1)m] + a“ 




















TF a. 

17 33 

98 276 

100 354 ~—- 1300 
225 979 4425 
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1.3.9 NEGATIVE INTEGER POWERS 


Riemann’s zeta function is defined to be ¢(n) = 77, — (it is defined for Re n > 1 
and extended to C). Related functions are 


1. a(n) = (1-2!) ¢(n) 3. 4(n) = (1—2-™)C(n) 

7 (27)?* (nf2)7* 
2. ¢(2k) Ik! |Box.| 4. B(2k +1) = 2k | Zo%,| 
5. The series B(1) = 1— + # —--- = 7/4 is known as Gregory’s series. 


6. Catalan’s constant is G = (2) © 0.915966. 


7. Riemann hypothesis: The non-trivial zeros of the Riemann zeta function (i.e., 
the {z;} that satisfy ¢(z;) = 0) lie on the critical line given by Re z; = 3. 


(The trivial zeros are z = —2, —4, —6,....) 


(Ht 


k=0 ( 


0.6931471805 0.7853981633 (oe) 
1.6449340668 0.8224670334 0.9159655941 = 1.2337005501 
1.2020569032 0.9015426773  0.9689461463 1.0517997903 
1.0823232337 0.9470328294  0.9889445517 =1.0146780316 
1.0369277551 0.9721197705  0.9961578281 — 1.0045237628 
1.0173430620 0.9855510912  0.9986852222  1.0014470766 
1.0083492774 0.9925938199 0.9995545079 = 1.0004715487 
1.0040773562 0.9962330018 0.9998499902  1.0001551790 
1.0020083928 0.9980942975  0.9999496842  1.0000513452 
1.0009945751 0.9990395075 0.9999831640 1.0000170414 


2 
3 
4 
5 
6 
7 
8 
9 


— 
Oo 





61m? /184320 


(A) ¢(2) 
8(3) ¢(4) 
B(5) = 5° /1536 ¢(6) = 18/945 
(7) = ¢(8) 
B(9) = 27779 /8257536  ¢(10 
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1.3.10 INTEGER SEQUENCES 


These sequences are in numerical order (disregarding leading zeros or ones). 


1. 


10. 


11. 


12. 


13; 


14. 





1, —1, —1, 0, —1, 1, —1, 0, 0, 1, —1, 0, —1, 1, 1, 0, —1, 0, —1, 0, 1, 1, —1, 0, 0, 1, 0, 


0, —1, —1, —1, 0, 1, 1, 1, 0, —1, 1, 1,0, —1, —1, —1, 0, 0, 1, —1, 0, 0, 0, 1, 0, —1, 0, 
1,0 Mobius function j.(n), n > 1 
1, 1,0, 1, 1,0, 0, 1, 1, 1,0, 0, 1, 0,0, 1, 1, 1, 0, 1, 0, 0, 0, 0, 2, 1, 0, 0, 1, 0, 0, 1, 0, 1, 
0, 1, 1, 0, 0, 1, 1, 0, 0, 0, 1, 0, 0, 0, 1, 2, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, 2, 0, 0, 1, 
0 Number of ways of writing n as a sum of 2 squares, n > 0 
1515902; 115 7, 332,05. 12,1, Ty, Sy dy 2s 1.25 1,.4, 1, 3,23.1,-3; 2.0; 1, 17, 1s D 
14,0, 1,1, 35 1-1, 1, 23-2415 de 52,25 1525 1535 1,3, Wy 12, Td, 25.09, 1, 1,. 1, 
2 Number of Abelian groups of order n,n > 1 
1, 1,1, 2, 1, 2, 1,5, 2, 2, 1,5, 1, 2, 1, 14, 1, 5, 1, 5, 2, 2, 1, 15, 2, 2, 5, 4, 1, 4, 1, 51, 
1,2, 1, 14, 1, 2, 2, 14, 1, 6, 1, 4, 2, 2, 1, 52, 2,5, 1,5, 1, 15, 2, 13, 2, 2, 1, 13, 1, 2, 4, 


267 Number of groups of order n,n > 1 
3, 4, 1, 2, 2, 3, 2, 3, 3, 4, 2, 3, 3, 4, 3, 4, 4, 5, 1, 2, 
, 2, 3, 3, 4, 3, 4, 4, 5, 3, 4, 4, 5, 4, 5, 5, 6, 1, 2, 2, 3, 
Number of 1’s in binary expansion of n,n > 0 
1, 2, 1, 2, 3, 6, 9, 18, 30, 56, 99, 186, 335, 630, 1161, 2182, 4080, 7710, 14532, 27594, 
52377, 99858, 190557, 364722, 698870, 1342176, 2580795, 4971008 
Number of binary irreducible polynomials of degree n, or n-bead necklaces, n > 0 
1, 2, 2, 3, 2, 4, 2, 4, 3, 4, 2, 6, 2, 4, 4, 5, 2, 6, 2, 6, 4, 4, 2, 8, 3, 4, 4, 6, 2, 8, 2, 6, 4, 4, 
4, 9, 2, 4, 4, 8, 2, 8, 2, 6, 6, 4, 2, 10, 3, 6, 4, 6, 2, 8, 4, 8, 4, 4, 2, 12, 2, 4, 6, 7, 4, 8, 2, 
6 d(n), the number of divisors of n,n > 1 
1, 1, 2, 2, 3, 4, 5, 6, 8, 10, 12, 15, 18, 22, 27, 32, 38, 46, 54, 64, 76, 89, 104, 122, 
142, 165, 192, 222, 256, 296, 340, 390, 448, 512, 585, 668, 760, 864, 982, 1113, 1260, 
1426 Number of partitions of n into distinct parts, n > 1 
1, 1, 2, 2, 4, 2, 6, 4, 6, 4, 10, 4, 12, 6, 8, 8, 16, 6, 18, 8, 12, 10, 22, 8, 20, 12, 18, 12, 28, 
8, 30, 16, 20, 16, 24, 12, 36, 18, 24, 16, 40, 12, 42, 20, 24, 22, 46, 16, 42 
Euler totient function ¢(n): count numbers < n and prime to n, for n > 1 
1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 16, 17, 19, 23, 25, 27, 29, 31, 32, 37, 41, 43, 47, 49, 53, 
59, 61, 64, 67, 71, 73, 79, 81, 83, 89, 97, 101, 103, 107, 109, 113, 121, 125, 127, 128, 
131 Powers of prime numbers 
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 60, 61, 67, 71, 73, 79, 
83, 89, 97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 168, 
173 Orders of simple groups 
1, 2, 3, 5, 7, 11, 15, 22, 30, 42, 56, 77, 101, 135, 176, 231, 297, 385, 490, 627, 792, 
1002, 1255, 1575, 1958, 2436, 3010, 3718, 4565, 5604, 6842, 8349, 10143, 12310, 
14883 Number of partitions of n,n > 1 
2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 2203, 2281, 3217, 
4253, 4423, 9689, 9941, 11213, 19937, 21701, 23209, 44497, 86243, 110503, 132049, 
216091, 756839, 859433 Mersenne primes: n such that 2” — 1 is prime 
1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, 610, 987, 1597, 2584, 4181, 
6765, 10946, 17711, 28657, 46368, 75025, 121393, 196418, 317811, 514229, 832040, 
1346269 Fibonacci numbers: F'(n) = F'(n — 1) + F(n — 2) 


22 


15. 


16. 


I. 


18. 


19. 


20. 


21. 


22. 


23% 


24. 


25. 


26. 


2h. 


28. 


29. 
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1, 2, 3, 6, 10, 20, 35, 70, 126, 252, 462, 924, 1716, 3432, 6435, 12870, 24310, 48620, 
92378, 184756, 352716, 705432, 1352078, 2704156, 5200300, 10400600, 20058300 
Central binomial coefficients: C'(n, |n/2|),n > 1 


1, 1, 1, 2, 3, 6, 11, 23, 47, 106, 235, 551, 1301, 3159, 7741, 19320, 48629, 123867, 
317955, 823065, 2144505, 5623756, 14828074, 39299897, 104636890, 
279793450 Number of trees with n unlabeled nodes, n > 1 
0,0, 1, 1, 2, 3, 7, 21, 49, 165, 552, 2176, 9988 

Number of prime knots with n crossings, n > 1 


0, 1, 2, 4, 5, 8, 9, 10, 13, 16, 17, 18, 20, 25, 26, 29, 32, 34, 36, 37, 40, 41, 45, 49, 50, 
52, 53, 58, 61, 64, 65, 68, 72, 73, 74, 80, 81, 82, 85, 89, 90, 97, 98, 100, 101, 104, 
106 Numbers that are sums of 2 squares 


1, 2, 4, 6, 10, 14, 20, 26, 36, 46, 60, 74, 94, 114, 140, 166, 202, 238, 284, 330, 390, 
450, 524, 598, 692, 786, 900, 1014, 1154, 1294, 1460, 1626, 1828, 2030, 2268, 2506 
Binary partitions (partitions of 2n into powers of 2), n > 0 


1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8192, 16384, 32768, 
65536, 131072, 262144, 524288, 1048576, 2097152, 4194304, 8388608, 16777216, 
33554432, 67108864 Powers of 2 


1, 1, 2, 4, 9, 20, 48, 115, 286, 719, 1842, 4766, 12486, 32973, 87811, 235381, 
634847, 1721159, 4688676, 12826228, 35221832, 97055181, 268282855, 743724984, 
2067174645 Number of rooted trees with n unlabeled nodes, n > 1 


1, 1, 2, 4, 9, 22, 59, 167, 490, 1486, 4639, 14805, 48107, 158808, 531469, 1799659, 
6157068, 21258104, 73996100, 259451116, 951695102, 3251073303 
Number of different scores in n-team round-robin tournament, n > 1 


1, 1, 2, 5, 12, 35, 108, 369, 1285, 4655, 17073, 63600, 238591, 901971, 
3426576, 13079255, 50107909, 192622052, 742624232, 2870671950, 11123060678, 
43191857688 Polyominoes with n cells, n > 1 
1, 1, 2, 5, 14, 38, 120, 353, 1148, 3527, 11622, 36627, 121622, 389560, 1301140, 
4215748, 13976335, 46235800, 155741571, 512559185, 1732007938, 
5732533570 Number of ways to fold a strip of n blank stamps, n > 1 
0, 1, 2, 9, 44, 265, 1854, 14833, 133496, 1334961, 14684570, 176214841, 
2290792932, 32071101049, 481066515734, 7697064251745, 130850092279664 
Derangements: permutations of n elements with no fixed points 
1, 3, 4, 7, 6, 12, 8, 15, 13, 18, 12, 28, 14, 24, 24, 31, 18, 39, 20, 42, 32, 36, 24, 60, 
31, 42, 40, 56, 30, 72, 32, 63, 48, 54, 48, 91, 38, 60, 56, 90, 42, 96, 44, 84, 78, 72, 48, 
124 a(n), sum of the divisors of n,n > 1 
1, 3, 4, 7, 9, 12, 13, 16, 19, 21, 25, 27, 28, 31, 36, 37, 39, 43, 48, 49, 52, 57, 61, 63, 
64, 67, 73, 75, 76, 79, 81, 84, 91, 93, 97, 100, 103, 108, 109, 111, 112, 117, 121, 124, 


127 Numbers of the form x? + xy + y” 
1, 20, 400, 8902, 197281, 4865609, 119060324, 3195901860, 84998978956, 
2439530234167 Number of possible chess games at the end of the n" ply. 


1, 362, 130683, 47046243, 16889859363, 6046709375131 
Number of Go games with n moves. 


For information on these and hundreds of thousands of other sequences, see “The 
On-Line Encyclopedia of Integer Sequences,” at oeis. org. 
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1.3.11 p-ADIC NUMBERS 


: : ; : a 
Given a prime p, a non-zero rational number «x can be written as 7 = BP where n 


is an integer and p does not divide a or b. Define the p-adic norm of x as |x|, = p~” 


and also define |0|,, = 0. The p-adic norm has the properties: 


1. |z|, > 0 for all non-negative rational numbers a 
2. |z|p = 0 if and only if « = 0 
3. For all non-negative rational numbers x and y 


(a) |tylp = |2lplylp 


(b) [a + y|p S max (|p, |¥lp) S |e lp + [Ylp 


Note the product formula: Iz] TT,e¢2,3,5,7,11,...} @lp = 1. 
Let Q,, be the topological completion of Q with respect to | - |p. Then Q, is the 
field of p-adic numbers. The elements of Q, can be viewed as infinite series: the 
; 0 ane: . ee 
series > ),,) Gn converges to a point in Q,, if and only if limp oo |an| >= 0. 











EXAMPLE = The number 39 = 27. 37° -5-7-117* has the different p-adic norms: 
pel Pe ae Pe ee ey ees) eo 
297 |, 1 297 |, 5 297 |,,, 
140 3 140 -1 1 
| =33 =27 “| arvana 
297 |, * |297|, 7 











1.3.12 DEBRUIJN SEQUENCES 
A sequence of length g” over an alphabet of size q is a de Bruijn sequence if every 
possible n-tuple occurs in the sequence (allowing wraparound to the start of the se- 


quence). There are de Bruijn sequences for any q and n. (In fact, there are qi /q! 
distinct sequences.) The table below contains some small examples. 


[apm [Tenet [ Sequence] 
2 01 


1 


01110100 


0101001101111000 

001220211 

000100201 101202102211121222 
0011310221203323 
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1.4 INTERVAL ANALYSIS 


1. Definitions 
(a) An interval x is a subset of the real line: 
e= |2z,t])={zEeR|e<z< Fh. 


(b) A thin interval is a real number: «x is thin if « = 7 








(c) mid() = = (e) |x| = mag() = max |2| 
Gun =" 5 = () (x) = mig(x) = min |2| 


The MATLAB® package INTLAB performs interval computations. 
2. Interval arithmetic rules 


[z+y,F+9] 


[z-9,F-y] 


[min(xy, 27, Ty, Ty), max(xy, xy, Ty, 7y)| 


EEE] toes 





3. Interval arithmetic properties 


y)z 


sub-distributivity | «( -t xz (equality holds if « is thin) 











sub-cancellation | # — y C (a + z) — 





4. Examples 
(a) [1,2] + [-2,1] = a 3] (c) [1,2] « [-2, 1] = [—4,2] 
(b) (1,2) - [1,2] =[-1,1] (d) [1,2]/[1,2] = [3,2] 
(e) If f(a, b; z) = ax + b then (when a = [1, 2], b = [5,7], and x = [2, 3]); 


f([1, 2], [5, 7]; [2, 3]) = [1, 2]-[2, 3]+[5, 7] = [1-2, 2-3)+[5, 7] = [7, 13] 


1.5. FRACTAL ARITHMETIC 25. 





1.5 FRACTAL ARITHMETIC 

Given a real-valued bijection f with f(0) = 0 and f(1) = 1 define 
coy =f" (f(x) + fy) cey=f" (f(x) — f(y) 
cOy =f (f(x) f(y) x@y =f (f(x)/F(y)) 


For example, if f(x) = «4 thenx © y = xy anda @y = (a%+ yt) 1/4, Note that 
the following hold: 

e Associativity: (« By) @z=c#O(y@z) and (tq#Oy)Oz=2#O (yOz) 

e Commutativity: 7 By=yOrxandtrOy=your 

e Distributivity: (« @ y) Oz = («#Oz) @ (yz) 


(1.5.1) 





The elements 0 and | satisfy O @a = xandlOwx=z. 


1.262 =OandrOr=1. 
2. In general, x Bx #20 cz. 
3. If0 Sz exists, it is denoted as Gx 


Define derivative and integration operations: 


b f (0) 
/ Fy(x) Odyx = f* (/ ray) 


(1.5.2) 


so that 

| LABOBE) _ 1B) 5 540)5.40) 0 LED 
> as (A(z)  B(z)) _ ds (A(z) @ of (B(«)) 

; dx dx dx 

3, df (AIB(@))) _ 4 (AIB(@)I) @ af (B(«)) 

, : dx dy B(a x) dpa 
4 / a wan © dyx = A(b) © A(a) 

5 ot ” aa’) © dz’ = A(z) 

fE Ja 
6, LEE) _ ¢-1 (P(F(@))) 


Special functions Given a function F define Fy as Fy(x) = f~* (F (f(2))). 
1. The exp, function satisfies exp s(x © y) = exp, x © exp, y and is the unique 
solution to the differential equation a = A(a) with A(0) = 
2. The In; function satisfies In s(x © y) = Inf x @ Ing y 
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1.6 MAX-PLUS ALGEBRA 


The max-plus algebra is an algebraic structure with real numbers and two opera- 
tions (called “plus” and “times’’); “plus” is the operation of taking a maximum, and 
“times” is the “standard addition” operation. Mathematically: 

The max-plus semiring Rmax is the set R U {—co} with two operations called 
“plus” (@) and “times” (@) defined as follows: 


e a®b=max(a,b) 
ea®@b=atb 


For a and b in Rmax the following laws apply: 








1. Associativity 2. Commutativity 
e (a@b)@c=a(bGc) eaeb=bea 
e (a®b)®@c=a@ (b@c) ea®b=bea 
3. Distributivity: (a@b)®c=aSc@b@c 
4. Idempotency of 6: aga=a 
Special elements are the “zero element” € = —oo and and the “unit element” e = 0. 


These have the properties: 


ececDa=a e@e«®a=e ee®Wa=a 


Let A and B be matrices and let [C];; be the ij element of matrix C. Then 
e [AG Bl = [Ali; © [B]ij = max([A]iy, [B]is) 
when A and B have the same size 
© [A® Bij = Bear (Alix ® [Blaj) = max([A]ia + [B]ay,---, [Alin + [B]ps) 
when A has p columns and B has p rows. 


Notes 


1. Rmax iS not a group since not all elements have an additive inverse. (Only one 
element has an additive inverse, it is —oo.) 
2. The equation a @ x = b need not have a unique solution. 
e Ifa<b,thenz=b 
e Ifa =b, then x can be any value with x < b 
e Ifa > b, then there is no solution 


ies) 


. In Rmax Matrix multiplication is associative. 
4. Defining exponential as a” = a®a®---@a=a+a+t+-::-+a=na we 
n times n times 
find a” @ a¥ = a** and (a*)¥ = a*¥, as in ordinary arithmetic. 
. The Kleene star of the matrix A is the matrix A* = J+ A+ A?+---. 
6. The completed max-plus semiring Rmax is the same as Rmax With the additional 
element +-oo and the convention (—0oo) + (+00) = (+00) + (—oo) = —00 


Nn 
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EXAMPLE 
10 —co 8 2 
Le a= | $] awa = [P a] Then 
Beet : _ 15@10 5@(-oo)} _ [15 —oo 
e Scalar multiplication of a matrix 5@A= E Q5 5@3 = ee 8 
ees _f10@8 -co@2] [10 2 
e Matrix addition AeB=|92) alae: 4 
e Matrix multiplication 
A@B= 10@8G(-co)@7 10@26(-co) @0 
7 5@8O387 5@263@0 
_ [18@(-co) 12@(-co)] _ [18 12 
~ | 13610 703 = aise “7 
1.7 COUPLED-ANALOGUES OF FUNCTIONS 
«J 
1. The coupled-logarithm, for x > 0, is In, (a) = i 
Note that: 
lim In, (#) =Inz In, (a*) = alng, (x) In, (eX) =a (1.7.1) 
ane 


2. The coupled-exponential is é.'= 


7 [l+«a]'/* whenl+«a>0 
0 otherwise 


Note that: 


lim ef = e* ai = eon exp,, (In,(x)) = a 
—— ye = Gexp la [((1 — K)aa'] when « 4 1 (1.7.2) 


fea dx = ———exp_«_[(l+«)az]+¢, whenk 4-1 
a : 


1.7.1 COUPLED-OPERATIONS 
1. Coupled-addition is defined by: x 6, y= x +y+ «xy. Note that: 





ene, =enuny 
In, (zy) = In, (x) © In, (y) (1.7.3) 
rOy@z=a+ytz2+K(cyt aczt yz) + K2axyz 


2. Coupled-subtraction is defined by: « ©, y = (a — y)/(1 + Ky) 

3. Coupled-division is defined by: « @, y = (a7 — y? + ne 

4. Coupled-multiplication is defined by: 7 ®, y = (x* + y*® — i, Note that: 
ee, =e Ing (2 @, y) = In, (x) + In, (y) 


n 
1 @eT1 Oe Onn =][]n vi = (eh taht---+ak—n+1)/" 
i=1 


28 


CHAPTER 1. NUMBERS AND ELEMENTARY MATHEMATICS 





1.8 NUMBER THEORY 


Divisibility The notation “a|b” means that the number a evenly divides the number b. 
That is, the ratio B is an integer. 


1.8.1 
1. 


2. 


CONGRUENCES 


If the integers a and b leave the same remainder when divided by the number n, 


then a and b are congruent modulo n. This is written a = b (mod n). 


If the congruence x* = a (mod p) has a solution, then a is a quadratic residue 


of p. Otherwise, a is a quadratic non-residue of p. 
(a) Let p be an odd prime. Legendre’s symbol () has the value +1 if a is 
a quadratic residue of p, and the value —1 if a is a quadratic non-residue 
of p. This can be written () = a-Y/? (mod p). 
(b) The Jacobi symbol generalizes the Legendre symbol to non-prime mod- 


uli. Ifn = ea pe then the Jacobi symbol can be written in terms of 
the Legendre symbol as follows 


(=) = Il (4) (1.8.1) 


i=1 


. An exact covering sequence is a set of non-negative ordered pairs 


{ (ai, bi) }i=1,....~ Such that every non-negative integer n satisfies n = a; 
(mod b;) for exactly one 7. An exact covering sequence satisfies 


a (1.8.2) 
lag  l-a _ 


i=1 
For example, every positive integer n is either congruent to | mod 2, or 0 
mod 4, or 2 mod 4. Hence, the three pairs {(1, 2), (0, 4), (2,4)} of residues 
and moduli exactly cover the positive integers. Note that 

x 1 x 1 


i fat Poe ALE) 


. Carmichael numbers are composite numbers {n} that satisfy a?~' = 1 


(mod n) for every a (with 1 < a < n) that is relatively prime to n. There are 
infinitely many Carmichael numbers. Every Carmichael number has at least 
three prime factors. If n = [], p; is a Carmichael number, then (p;—1) divides 
(n — 1) for each i. 

There are 43 Carmichael numbers less than 10° and 105,212 less than 10°. 
The Carmichael numbers less than ten thousand are 561, 1105, 1729, 2465, 
2821, 6601, and 8911. 
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b (mod n), and b = c (mod n), thena =c (mod n). 





b=a’ 








b’ (mod n). 





a’ (mod n), then a? = (a’)? (mod n), a3 = (a’)? (mod n), etc. 


1.8.1.1. Properties of congruences 
1. Ifa=b (mod n), then b =a (mod n). 
2. Ifa= 
3. Ifa=a’ (mod n), and b= 0b’ (mod n), then a 
4. Ifa= 
5 


. If GCD(k, m) = d, then the congruence ka = n (mod m) is solvable if and 


only if d divides n. It then has d solutions. 
6. If pis a prime, then a? = a (mod p). 
7. If pis a prime, and p does not divide a, then a?~! = 1 (mod p). 
8 
9 


. If GCD(a, m) = 1, thena?™ =1 


(mod m). (See Section 1.8.12 for d(m).) 


. If pis an odd prime and a is not a multiple of p, then Wilson’s theorem states 
(p—1)J!=- (2) a®-)/2 (mod p). 


qd 
integers and b > 3, then (=) 


11. 


(— 


. If p and q are odd primes, then Gauss’ law of quadratic reciprocity states that 


(4) (4) = (—1)”-DG-)/4_ Therefore, if a and b are relatively prime odd 
Pp 


)(a-DO-1)/4 (2) . 
a 


The number —1 is a quadratic residue of primes of the form 4k + 1 and a 


non-residue of primes of the form 4k + 3. That is 


(=) = (je = 


The number 2 is a quadratic residue of primes of the form 8/ + 1 and a non- 


12. 





(mod 4) 


(mod 4) 


+1 whenp=1 
—1 whenp=3 





residue of primes of the form 8k + 3. That is 


P 


(=) = (-1e-Ds _ C when p = +1 


(mod 8) 
(mod 8) 





—1 whenp=+3 


1.8.2 CHINESE REMAINDER THEOREM 


Let m1,™mg,.. 
congruences 


ay 


a2 


v=, 


has a unique solution modulo M = m 
written as 


x= ai Myy1 + agMoy2 +--+: + a,M, yr 


.,m, be pairwise relatively prime integers. 





The system of 


mod my) 
mod mz) 
(1.8.4) 
mod m,) 
mg:++:M,. This unique solution can be 


(1.8.5) 


where My = M/mg, and yx is the inverse of M;, (modulo mz). 
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EXAMPLE Por the system of congruences 


x=1 (mod 3) 

x =2 (mod 5) 

x =3 (mod 7) 
we have M = 3-5-7 = 105 with M; = 35, Mz = 21, and M3 = 15. The equation for 
yi is Myy1 = 35y1 = 1 (mod 3) with solution y; = 2 (mod 3). Likewise, y2 = 1 
(mod 5) and y3 = 1 (mod 7). This results ing = 1-35-24+2-21-14+3-15-1 =52 
(mod 105). 


1.8.3 CONTINUED FRACTIONS 


The symbol [a9, a1,...,@y], with a; > 0, represents the simple continued fraction, 
1 
[a0,@1,.--,@n] = @9 + ———, (1.8.6) 
+ 
ay ; I 
a 
: 1 
a3+ 
ada + 
: 1 
Rear een 
an 
The n™ convergent (with 0 < n < N) of [ao,a1,...,ay] is defined to be 


[a0, @1,---,@n]. If {pn} and {q,} are defined by 


Po=a4, Pi =aiao +1, Pp = GnPn—1 + Pn—-2 (2 <n< N) 
go = 1, qd = 41, Qn = AnQn—1 + Gn—2 (2 <n< N) 


then [a9,@1,---,;@n] = Pn/Qn. The continued fraction is convergent if and only if 
the infinite series }>>° a; is divergent. 

If the positive rational number x can be represented by a simple con- 
tinued fraction with an odd (even) number of terms, then it is also repre- 
sentable by one with an even (odd) number of terms. (Specifically, if a, = 
1 then [ao,a1,..-,@n-1,1] = [a0,@1,.-.,@n-14+1], and if a, > 2, then 
(a9, @1,---,@n] = [@0,@1,---,@, — 1, 1].) Aside from this indeterminacy, the sim- 
ple continued fraction of x is unique. The error in approximating by a convergent is 


bounded by 


hn 1 1 
c eee eo, (1.8.7) 





dn | InIn+1 o 


The algorithm for finding a continued fraction expansion of a number is to re- 
move the integer part of the number (this becomes a,;), take the reciprocal, and repeat. 
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For example, for the number 7: 


Bo = 7 & 3.14159 ao = |6o| =3 
Bi = 1/(Bo — ao) © 7.062 a, = |i] =7 
Bq =1/(81 — a1) & 15.997 az = |G2| = 15 
B3 = 1/(B2 — a2) & 1.0034 ag = |63| =1 
Ba = 1/(B3 — a3) © 292.6 a4 = [84] = 292 


Since 7 = [3,7, 15,1, 292,1 yds 1,2,1,3,1,14,2,...] approximations to 7 may be 
found from the convergents: = ~ 3.142, Be r 3.14150, $8 ~ 3.1415929. 

Since e = [2,1,2,1, Le 1,1,6,...,1,1,2n,...] approximations to e may be 
found from the convergents: § = = 2.6, u e 2.75, _ es 2.714, ST x  2.7187,. 

A periodic continued fadion) is an infinite continued! fraction in which 4 a = 
ai+k for alll > L. The set of partial quotients az, ap41,..., @p4%—1 is the period. 


A periodic continued fraction may be written as 
[a0,@1,..-,@L—1, @£,QL41,---,OL+k—1]- (1.8.8) 


For example, 


V2 = [1,2] V6 = [2, 2, 4| V10 = [3,6] V14 = [3,1,2,1,6] 
d= (i, 1,2] v7 =([2,1,1,1,4 VII = [3,3,6] V15 = [3, 1,6] 
V5 = [2,4] V9 = [3] 13 =(3,1,1,1,.1,6 V17 = [4,8] 


If x = [b, a] thenz = $(b+4/b? + +8). For example, [I] = [1,1] = (1+V5)/2, 
(2] = [2,2] = 14 V2, and [2,1] =1+ V3. 


Functions can be represented as continued fractions. Using the notation 


ay a, a2 a3 a4 
6 — eS, 1.8.9 
ap bate bd ae ae 


Gigs 
bat... 


we have (allowable values of z may be restricted in the following) 








@ n+) -Seekee 
Oe =e se eee 
(c) tanz= 222... 
(d) tanhz = ZEZZZ... 
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1.8.4 DIOPHANTINE EQUATIONS 


A diophantine equation is one whose solutions are integers. 


1 


2 


Fermat’s last theorem states that there are no integer solutions to x" +y”" = 2”, 


when n > 2. This was proved by Andrew Wiles in 1995. 

The similar, but slightly different, equation x” + y” = z”*++ has parametric 
solutions given by x = a(a™ + b™)", y = b(a™ + 0™)", z = (a™ + 0™)” 
where gcd(m,n) = 1 and nv — mu = 1. 


. The Hurwitz equation, x? + 73 +--+ + a2 = ax1@2--- Xp, has no integer 


solutions for a > n. 


. Bachet’s equation, y2 = «° + k, has no solutions when k is: —144, —105, 





78, —69, —42, —34, —33, —31, —24, —14, —5, 7, 11, 23, 34, 45, 58, 70. 


. Ramanujan’s “square equation,” 2” = 7 + x, has solutions for n = 3, 4, 5, 7, 


and 15 corresponding to x = 1, 3,5, 11, and 181. 


: ee er a 


ay > ag >-++ > Gm, 6) = bg > +++ = bn, ay > 1, and m < n. For example: 
52 = 47 4.37 
123 + 13 = 103 +. 98 
158* + 59* = 134+ + 1334 
422481* = 4145604 + 2175194 + 958004 
144° = 133° + 110° + 84° + 27° 





Given k and ™m the least value of n for which a solution is known is as follows: 


12 12 





. Cannonball problem: If n? cannonballs can = stacked to form a square pyra- 


mid of height k, what are n and k? The Diophantine equation is ss, v= 
ak(k + 1)(2k +1) = n? with solutions (k,n) = (1,1) and (k,n) = (24, 70). 


. The Euler equation 2" = 7x? + y? has a unique solution, with x and y odd, 


forn > 3: 
gn/2+1 


V7 
where a, = ([n — 2] tan~! V7). 
The solutions are (n, 7, y) = {(3, 1, 1), (4, 1, 3), (5, 1, 5), (6,3, 1),...} 


r= lsinan| y = 2"/7+1 |cos ap| 
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9. Apart from the trivial solutions (with s = y = 0 or x = uw), the general 
solution to the equation x? + y? = u3 + v° is given parametrically by 


= \[1— (a —3d)(a? + 30*)] = y=A[(a + 3d)(a? + 307) — 1] 
u = »[(a + 3b) — (a? + 307)?] v = X[(a? + 307)? — (a — 38)] 
where {A, a, b} are any rational numbers except that \ 4 0. 
10. A parametric solution to 2* + y* = u* + v4 is given by 
gz =a’ +a°b? — 20354 + 3a7b° + ad® 
y=e') =e Ia PP te + 
g=a' fol —Ia°h* 2a +a" 


v = a°b + 3a°b? — 2a4b? + a2b® +b” 

















11. Parametric solutions to the equation (A? +.B?)(C?+D?) = E?+F? are given 
by the Fibonacci identity (a?-++b)(c? +d?) = (ackbd)?+(bc#ad)? = e?+f?. 
A similar identity is the Euler four-square identity (a? + a3 + a3 + 
ai) (b7 + b3 + b3 + b?) = (ayby = ab = a3b3 = a4b4)? + (ayb2 + ab, ae 
ag3b4— a4b3)? + (azb3 — a 9b4+a3b,+ agb2)? + (ayb4 + a2b3 —azb2 — a4b,)?. 
12. The only integer solutions to the equation z¥ = y* are (2,4) and x = y. Non- 


integral solutions are given by {a = (1 + 1)" y= (1 + aye}. Setting 




















u = 2,3,... yields the rational solutions (3, ot), (g 


1.8.4.1 Pythagorean triples 


If the positive integers A, B, and C satisfy A? + B? = C?, then the triplet (A, B, C) 
is a Pythagorean triple. A right triangle can be constructed with sides of length A 
and B and a hypotenuse of C’. There are infinitely many Pythagorean triples. 

A general solution to A? + B? = C?, with GCD(A, B) = 1 and A even, is 


A=2zy, B=x? -y’, C=2' +y’, (1.8.10) 


where x and y are relatively prime integers of opposite parity (i.e., one is even and 
the other is odd) with x > y > 0. The table below left shows some Pythagorean 
triples with the associated (a, y) values. 


| « y| A= 2ry B=a2-y C=ax*+y 





A different general solution is obtained by factoring even squares as n? = 2pq. Here 
A=n+p, B=n+q,andC =n+p+q. The table above right shows the (p, q) and 
(A, B, C) values obtained from the factorizations 36 = 2-1-18 = 2-2-9 =2-3-6. 
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1.8.4.2 Pell’s equation 


Pell’s equation is 2? — dy? = 1. The solutions, integral values of (x, y), arise from 
continued fraction convergents of Vd. If (x, y) is the least positive solution to Pell’s 
equation (with d square-free), then every positive solution (x, yx) is given by 


tp + ypVd = (x + yvd)* (1.8.11) 


The following tables contain the least positive solutions to Pell’s equation with d 
square-free and d < 100. 





936 
251 30 
3,480 413 
2,281,249 267,000 
2,049 3,699 430 

13 351 

3,482 53 

24,335 80 
48 163 18 
50 82 9 
66,249 285,769 30,996 
89 12 10,405 1,122 
151 28 3 
19,603 2,574 500,001 53,000 
530 69 1,574 165 
1,766,319,049 | 226,153,980 12,151 1,260 
63 2,143,295 221,064 
129 16 39 4 
65 97 | 62,809,633 | 6,377,352 

48,842 
EXAMPLES 

1. The number V2 has the continued fraction expansion [1, 2, 2,2,2,...], with conver- 
gents 3, Z, i, =, 2. .... In this case, every second convergent represents a solution: 


372.27 =1, 177 —2-12? =1, 99? -2-70? =1 


2. The least positive solution for d = 11 is (a, y) = (10,3). Since (10 + 3V11)? = 
199 + 60/11, another solution is given by (x2, y2) = (199, 60). 
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1.8.4.3 Lagrange’s theorem 


Lagrange’s theorem states: “Every positive integer is the sum of four squares.” After 
showing every prime can be written as the sum of four squares, the following identity 
can be used to show how products can be written as the sum of four squares: 


(wi +05 +03 + 24) (yi tug +93 +94) = 
(iyi + 22yo + x3y3 + ways)? + (a1y2 — cay1 + e3y4 — Lays)” 


+ (iys — x3y1 + tayo — toys)? + (ziys — cay + woy3 — 23y2)? (1.8.12) 











Note also the identity for sums of two squares: 


(xj + 23) (yi + ys) = (wiye + 2291)? + (wey2 — e1y1)? (1.8.13) 


1.8.5 GREATEST COMMON DIVISOR 


The greatest common divisor of the integers n and m is the largest integer that evenly 
divides both n and m; this is written as GCD(n, m) or (n,m). The Euclidean algo- 
rithm is frequently used for computing the GCD of two numbers; it utilizes the fact 
that m = |= | n+pwhereO<p<n. 

Given the integers m and n, two integers a and b can always be found so that 
am + bn = GCD(n,m). 

Two numbers, m and n, are said to be relatively prime if they have no divisors in 
common; i.e., if GCD(a, b) = 1. The probability that two integers chosen randomly 
are relatively prime is 7/6. 


EXAMPLE Consider 78 and 21. Since 78 = 3 - 21 + 15, the largest integer that evenly 
divides both 78 and 21 is also the largest integer that evenly divides both 21 and 15. 
Iterating results in: 





78 = 3-214 15 
21=1-154+6 
15=2-64+3 
6=2-3+0 





Hence GCD(78, 21) = GCD(21,15) = GCD(15,6) = GCD(6, 3) = 3. Note that 
78-(—4) +21-15 =3. 


1.8.6 LEAST COMMON MULTIPLE 


The /east common multiple of the integers a and b (denoted LCM(a, b)) is the least 
integer 7 that is divisible by both a and b. The simplest way to find the LCM of a 


and b is via the formula LCM(a, b) = ab/GCD(a, b). For example, LCM(10, 4) = 
10-4 _ «10-4 _ 99 
- 


GCD(10,4) ~~ 
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1.8.7 MOBIUS FUNCTION 
The Mobius function is defined by 


1. w(1) =1 
2. u(r) = 0 if n has a squared factor 
3. (pipe ...pe) = (—1)* if all the primes {p1,...,p,} are distinct 


Its properties include: 
1. If GCD(m, n) = 1 then pp(mn) = pe(m) p(n) 


1 ifn=1 
2. Ne 
dH ‘ ee 


= 1 
3. Generating function: be p(n)n-* = as) 
8 
n=0 
4. The Mobius inversion formula states that, if g(n) = S- f(d), then 
d\n 
= “) g(a) = S~ wld)g (= 1.8.14 
Fin) = Yin (G) a = Fah (=). 8a) 


d\n d\n 


The table below has the value of .(10n +k) in row n_ and column _k. For example, 
u(2) = —1, (4) = 0, and (6) = 1. 


a 





| 


0 
1 
0 
i 
0 
0 
0 
1 
0 
1 
0 
1 
0 
1 
0 
1 


| 
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1.8.8 PRIME NUMBERS 


1. A prime number is a positive integer greater than | with no positive, inte- 
gral divisors other than | and itself. There are infinitely many prime num- 
bers, 2,3,5,7,.... The sum of the reciprocals of the prime numbers diverges: 
pce cet Ma tae as el 

2. Twin primes are prime numbers that differ by two: (3,5), (5,7), (11,13), 
(17,19),.... It is not known whether there are infinitely many twin primes. 
The sum of the reciprocals of the twin primes converges; the value 


pee on ee ee On Gee ees © ee Oe a 
NBS 5 8 fi 08) a pee 


known as Brun’s constant is approximately B + 1.90216054. 

3. For every integer n > 2, the numbers {n! + 2,n! + 3,...,n! +n} area 
sequence of n — 1 consecutive composite (i.e., not prime) numbers. 

4. Dirichlet’s theorem on primes in arithmetic progressions: Let a and b be rel- 
atively prime positive integers. Then the arithmetic progression an + b (for 
n =1,2,...) contains infinitely many primes. 

5. Goldbach conjecture: every even number is the sum of two prime numbers. 

6. The function 7(a) represents the number of primes less than x. The prime 
number theorem states that m(x) ~ 2/ log a as % > oo. For x > 17, we have 


I 2_<r(a) < 1.265 <—. The number of primes less than a given number is: 
og x og x 


x 100 1000 10,000 10° 10° 107 108 
ma) | 25 168 1,229 9,592 78,498 664,579 5,761,455 











x 101° 1015 107! 
n(x) | 455,052,511 29,844,570,422,669 21,127,269,486,018,731,928 
1.8.8.1. Prime formulas 


The polynomial x? — x + 41 yields prime numbers for x = 0, 1, 2,..., 39. 
The set of prime numbers is identical with the set of positive values taken on by 
the polynomial of degree 25 in the 26 variables {a, b,..., z}: 








(k+2){1—[wz+h+j—q)’—[(gk+2g+k+1)(h+j)+h— 2] —[2n+p+q+z—e]? 
—[16(k+1)° (k+2)(n-+1)?-+1— fle? (e+2)(a+1)2+ 1-07 — [(a?—Dy?-+ 1-2"? 
— [16r?y4(a? — 1) +1 —w’)? — [((a+ u?(u? — a))? — 1)(n + 4dy)? +1 — (a + cu)? )? 
=Inaleo=9) =[fe* =1P 41m P= lee 1 = 9? = tien 1 
+b(2an+2a—n? —2n,—2) —m)’ —[¢+y(e—p—1)+s(ap+2a— p* — 2p — 2) — 2]? 

— [z+ pl(a— p) + t(2ap — p* — 1) — pm]"} 
Although this polynomial appears to factor, the factors are improper, P = P-1. Note 
that this formula will also take on negative values, such as —76. There also exists 
a prime representing polynomial with 12 variables of degree 13697, and one of 10 
variables and degree about 104°. 
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1.8.8.2 Lucas—Lehmer primality test 
Define the sequence r,41 = 2, — 2 with r; = 3. If pis a prime of the form 4n + 3 
and M,, = 2? — 1, then M,, will be prime (called a Mersenne prime) if and only if 
M, divides rp_y. 

This simple test is the reason that the largest known prime numbers are 
Mersenne primes. For example, consider p = 7 and M7 = 127. The {r,,} sequence 
is {3, 7, 47, 2207 = 48, 2302 = 16, 254 = 0}; hence M7 is prime. 


1.8.8.3 Primality test certificates 


A primality certificate is an easily verifiable statement (easier than it was to deter- 
mine that a number is prime) that proves that a specific number is prime. There are 
several types of certificates. The Atkin—Morain certificate uses elliptic curves. 

To show that the number p is prime, Pratt’s certificate consists of a number a 
and the factorization of the number p — 1. The number p will be prime if there exists 
a primitive root a in the field GF[p] that satisfies the conditions a?~' = 1 (mod p) 
and a‘?-))/4 41 (mod p) for any prime gq that divides p — 1. 


EXAMPLE © The number p = 31 has p— 1 = 30 = 2-3-5, and a primitive root is given 
by a = 3. Hence, to verify that p = 31 is prime, we compute 











3@1-D/2 _ 3! = 14348907 = -14 1 (mod 31), 

381-D/3 _ 310 — 59949 = 295 41 (mod 31), 

331-)/5 _ 36 = 799 = 1641 (mod 31), 
. 2 

331-1) _ (gen) =(-1)?=1 (mod 31). 


1.8.8.4 Probabilistic primality test 


Let n be a number whose primality is to be determined. Probabilistic primality tests 
can return one of two results: either a proof that the number n is composite or a 
statement of the form, “The probability that the number n is not prime is less than e,” 
where € can be specified by the user. Typically, we take « = 2~7°° < 10-®. 

From Fermat’s theorem, if b 4 0, then b”~' = 1 (mod n) whenever n is prime. 
If this holds, then n is a probable prime to the base b. Given a value of n, if a value 
of b can be found such that this does not hold, then n cannot be prime. It can happen, 
however, that a probable prime is not prime. 

Let P(x) be the probability that n is composite under the hypotheses: 


1. nis an odd integer chosen randomly from the range [2, ]; 
2. bis an integer chosen randomly from the range [2,n — 2]; 
3. nis a probable prime to the base b. 


Then. P(x) < doga)—*% fore > 19100, 

A different test can be obtained from the following theorem. Given the number 
n, find s and t with n — 1 = 2*t, with t odd. Then choose a random integer b from 
the range [2,n — 2]. If either 


b'=1 (mod n) nn (mod n), forsomei < s, 


1.8. NUMBER THEORY 39 


then n is a strong probable prime to the base b. Every odd prime must pass this test. 
Ifn > 1 is an odd composite, then the probability that it is a strong probable prime 
to the base b, when b is chosen randomly, is less than 1/4. 

A stronger test can be obtained by choosing k independent values for b in the 
range [2,7 — 2] and checking the above relation for each value of b. Let P;,(x) be 
the probability that n is found to be a strong probable prime to each base b. Then 
Py(x) < 4-@-) P(x) /(1 — P(a)). 


1.8.9 PRIME NUMBERS OF SPECIAL FORMS 


1. The largest known prime numbers, in descending order, are 


Prime number Number of digits 


(1) 2 —1 22,338,618 
(2) 257885161 __ 1 17,425,170 
(3) 243112609 _ 1 12,978,189 
(4) 242643801 __ 1 12,837,064 
(5) 937156667 _ 1 11,185,272 
(6) gezneetay —y .9.808,358 
(7) 931172165 1 1 9 383,761 
(8) 230402457 __1 9.152.052 


(9) 275964951 _1 7,816,230 
(10) 274036583 1 7,235,733 
2. The largest known twin primes are 2996863034895 - 271799999 + 1 (with 
388,342 digits). 
3. There exist constants 0 ~ 1.30637788 and w = 1.9287800 such that |03" | 


gw 








and | 27 are prime for every n > 1. 
Sy 


n 
4. Primes with special properties 


(a) A Sophie Germain prime p has the property that 2p + 1 is also prime. 
Sophie Germain primes include: 2, 3, 5, 11, 23, 29, 41, 53, 83, 89, 113, 
131, ..., 3714089895285 - 20000 4, 

(b) An odd prime p is called a Wieferich prime if 2?-! = 1 (mod p?). 
Wieferich primes include 1093 and 3511. 

(c) A Wilson prime satisfies (p — 1)! = —1 (mod p?). Wilson primes in- 
clude 5, 13, and 563. 


5. For each n below {a + md | m = 0,1,...,n — 1} is an arithmetic sequence 
of n prime numbers. (Note that 23# = 3-5-7-11-13-17-19- 23.) 
n a d 
3 3 2 
4 61 6 
5 11 30 
10 199 210 


26 43142746595714191 23681770-23# 
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6. Define p# to be the product of the prime numbers less than or equal to p. 


Values of n or p for which the form is prime 


as 
gn 
n! — 


p41 101,234. (erat primes) | 
2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 
1279, 2203, 2281, 3217, 4253, 4423, 9689, 9941, 11213, 
19937, 21701, 23209, 44497, 86243, 110503, 132049, 216091, 


il 
1 
756839, 859433, ..., 74207281,... (Mersenne primes) 
1 | 3, 4, 6, 7, 12, 14, 30, 32, 33, 38, 94, 166, 324, 379, 469, 546, 
974, 1963, 3507, 3610, 6917, ... (factorial primes) 
n!+1 | 1, 2, 3, 11, 27, 37, 41, 73, 77, 116, 154, 320, 340, 399, 427, 
Final 872, 1477, 6380, ... (factorial primes) 
p# —1 | 3,5, 11, 13, 41, 89, 317, 337, 991, 1873, 2053, 2377, 4093, 
4297, 4583, 6569, 13033, 15877, ... 
a (primorial or Euclid primes) 
p# +1 | 2, 3,5, 7, 11, 31, 379, 1019, 1021, 2657, 3229, 4547, 4787, 
11549, 13649, 18523, 23801, 24029, 42209, ..., 145823, 
366439, 392113,... (primorial or Euclid primes) 
n2” +1] 1, 141, 4713, 5795, 6611, 18496, 32292, 32469, 59656, 90825, 
peers 262419, 361275, ..., 481899, ... (Cullen primes) 
n2” —1 | 2,3, 6, 30, 75, 81, 115, 123, 249, 362, 384, 462, 512, 751, 822, 
5312, 7755, 9531, 12379, 15822, 18885, ... 143018, 151023, 
667071,... (Woodall primes) 


a” —1 
a-—1l 


Values of n for which the form is prime 
2” —1 . . 
i These are Mersenne primes; see the previous table. 
3" — 1 
5 3, 7, 13,71, 103,541, 1091, 1367, 1627, 4177, 9011, 9551, ... 


2 : 3, 7, 11, 13, 47, 127, 149, 181, 619, 929, 3407, 10949, 13241, 





7. Prime numbers of the form 





(called repunits). 


4 


2, 3, 7, 29, 71, 127, 271, 509, 1049, 6389, 6883, 10613, 19889, 


5, 13, 131, 149, 1699, 14221, 35201, 126037, 371669, ... 
10” — 1 
2, 19, 23, 317, 1031, 49081, 86453, 109297, 270343, ... 
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8. Prime numbers of the forms 2” + a, 10" + b and 16” +c 














In the following table, for a given value of n, the quantities ax, b+, and c 
are the least values such that 2” + ai, 10” + bs, and 16” + cx are probably 
primes. (A probabilistic primality test was used.) 


























For example, for n = 3, the numbers 23 -1=7,23+3 = 11, 10?-3 = 997, 
10° + 9 = 1009, 16° — 3 = 4093, and 163 + 3 = 4099 are all prime. 





— 
ONAN O WwWrHAO Fr 
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_ 
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~] 
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1.8.10 PRIME NUMBERS LESS THAN 7,000 


The prime number pion+x is found by looking at row n_ and column _k. For exam- 
ple, the 9" prime number is 23 and the 18" prime number is 61. 








11 13 17 19 23 
47 53 59 61 67 
97 101 103 107 109 
149 151 157 163 167 
197 199-211 223 227 
257 263 269 271 277 


313 317 331 337 347 
379 383 389 = 397 401 
439 443 449 457 461 
499 503 509 521 523 
571 S77 587. 5593 599 


631 641 643 «647-653 
691 701 709 719-727 
761 769 = 773, 787-797 
829, 839 853 857 859 
907 911 919 929 937 


977 983 991 997 1009 
1039 1049 1051 1061 1063 
1103. 1109) «1117 1123 1129 
1187 1193 1201) 1213 1217 
1259 1277) «1279 =1283 1289 


1319 1321 1327 1361 1367 
1427) 1429 1433 1439 1447 


a 
nach lla isa ARWNF OO 


= 
— 


ee ee 
ines Tal tee 


1483 1487 1489-1493: 1499 
1553. 1559 1567) 1571 =: 1579 
1613. 1619 1621 1627 1637 


1697 1699 1709 1721 1723 
1777 =—-1783 1787S :1789_—s-1801 
1867 1871 1873 1877-1879 
1933 1949 1951 1973 1979 
2011 2017 2027 2029 2039 


2087 2089 2099 2111 2113 
2153, 2161 2179 2203 2207 
2251 2267 2269 2273 2281 
2333 2339 «2341 =62347 2351 
2389 2393 2399 2411 2417 


2467 2473 2477 «2503-2521 
2557 2579 2591 2593 2609 
2659 2663 2671 2677 2683 
2711 2713 2719 =2729 = 2731 
2789 2791 2797 2801 2803 


2857 2861 2879 2887 2897 
2953 2957 2963 2969 2971 
3037 3041 3049 3061 3067 
3121 3137 3163 3167 3169 
3217 «93221 =93229) «3251 = 3253 
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3313: 
3373 
3467 
3541 
3617 


3697 
3779 
3863 
3931 
4021 


4111 
4211 
4271 
4363 
4457 


4547 
4639 
4721 
4799 
4909 


4973 
5051 
5147 
5233 
5333 


5419 
5501 
5573 
5659 
5743 


5839 
5897 
6029 
6101 
6199 


6271 
6343 
6427 
6551 
6637 


6709 
6803 
6883 
6971 
7043 


7159 
7243 
7349 
7477 
7541 


3319 
3389 
3469 
3547 
3623 


3701 
3793 
3877 
3943 
4027 


4127 
4217 
4273 
4373 
4463 


4549 
4643 
4723 
4801 
4919 


4987 
5059 
5153 
3237 
5347 


5431 
5503 
5581 
5669 
5749 


5843 
5903 
6037 
6113 
6203 


6277 
6353 
6449 
6553 
6653 


6719 
6823 
6899 
6977 
7057 


7177 
7247 
7351 
7481 
7547 


3329 
3407 
3499 
3559 
3637 


3719 
3803 
3889 
3967 
4051 


4133 
4229 
4289 
4397 
4483 


4567 
4651 
4733 
4817 
4933 


4999 
5081 
5171 
5273 
5381 


5441 
5519 
5623 
5689 
5783 


5851 
5927 
6047 
6131 
6217 


6299 
6361 
6469 
6569 
6661 


6737 
6829 
6911 
6991 
7079 


7193 
7283 
7393 
7489 
7559 
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1.8.11 FACTORIZATION TABLE 


The following table has the factors of all numbers up to 1029. 
When a number is prime, it is shown in a boldface font. 


2 22 5 2-3 5) 
22.3 2-7 3-5 24 2-32 
23.3 52 2-13 aad 
2:17 5-7 22.32 2-19 

2-3-7 27.11 37-5 2-23 24.3 

22.13 2-33 5-11 23.7 2-29 

2-31 ‘7 2 5-13 2-3-11 27.17 

23.3? 2-37 3-5? 27-19 2-3-13 

2-41 22.3.7 5-17 2-43 23-11 

27.93 3-31 2-47 5-19 25-3 2-72 

2:3-17 103 23-13 3-5-7 2-53 27.38 

24.7 1132-38-19 5-23 -2?-.29 2-59 
1122-61 3-41 27.31 53 2-32.7 a7 
131s 2?-3-11 7-19 2-67 33-5 23-17 2-3-23 
3-47 2-71 11-13 24.32 5.29 2-73 27.37 
151. 23-19—32-17 -2-7-11 5-31) -2?-3-13 2-79 
7-23 2-34 163 = 27-41 3-5 - 11 2-83 23.3.7 
37-19 27-43 173 2-3-29 52-7 24-11 2-89 
181 -.2-7-13 3-61. -23-23)-5-37—-2-3-31 22.47 
191 -.28.3 193 2-97 3-5-13 22-72 2-32-11 
3-67 2-101 7-29 2?-3-175-41 2-103 24.13 
2110-27-53. 3-71-2107 5-43 28-38 2-109 
13-17 2-3-37 223 25-7 32.52 2.113 2?.3-19 
3-7-11 23-29 233). 2-32-13. 5-47-2259 2-7-17 
2412-11238 27.61 5-72 2-3-41 23.31 
251 = - 2?.3?-7,- 11-23. 2-127 3-5-17 28 2-3-43 
32.29 2-131 263 23-3-11 5-53  2-7-19 22.67 
271.0 24-17) 3-7-13 2-187 52-11 2?-3-23 2-139 
281 «-.2-3-47 283) 22-71 3-55-19 2-11-13 25.32 
3:97 27-73 293 2.3-72 5-59 23.37 2-149 
7-43 2-151 3-101 24-19 5-61 2-32-17 2?.7-11 
311-283-138 3132-157: 32-5-7 22-79 2-3-53 
3-107 2-7-23 17-19 22-34 52-13 2-163 23.41 
331 =. 2-83: 32-37 2-167 5-67 —_24-3-7 2-13? 
11-31 2-37-19 73 23.43 3-5-23 2-173 2?..3.29 
33-13 25-11 353. -.2-3-59 5-71 22-89 2-179 
1922-181. 33-112 2?-7-13 5-73 -2-3-61 24.23 
7-53 27-3-31 373 2-11-17 3-53 23-47 2-33-7 
3-127 2-191 383 27-3 5-7-11 2-193 27.97 
17-23 23.72 3-181 2-197 5-79 22-32-11 2-199 
401s. 2-38-67. 13-31 27-101 34-5 = -2-7-29 23.3-17 
3-137 27-103 7-59 2-37-23 5-83 25-13 2-11-19 
421 2-211 337-47: 2-53) 52-17 2-38-71 27.107 3-11-13 
431 24-38 433. 27-31 -3-5-29 27-109 2-3-73 439 
32.72 2-13-17 443 22.3-37 5-89 2-223 28.7 449 
11-41 27-113 3-151 2-227 5-7-13 23-3-19 2-229 33.17 
461 =. 2-3-7-11 463 ~— 24.29. 35-31 2-233 22.32.13 7-67 
3-157 23-59 11-43 2-3-79 57-19 2?-7-17 2-239 479 
13-37 2-241 3-7-23 27-112 5-97 2-35 23.61 3-163 


Oo 
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491 27.3-41 17-29 2-13-19 37-5-1127-31 7-71 2-3-83 499 
3-167 2-251 503 2.32.7 5-101 2-11-23 3-132 22-127 509 
773 2? 33-19 2-257 5-103 2?-3-43 11-47 2-7-37 3-173 
521 2-32.29 523 27.131 3-52-7 2-263 17-31 24-3-11 23? 
37-59 2?-7-19 13-41 2-3-89 5-107 23-67 3-179 2-269 7.11 
541 2-271 3-181 25-17 5-109 2-3-7-13 547 27.137 32-61 
19-29 23.3-23 7-79 2-277 3-5-37 27-139 557 2-32-31 13-43 
3-11-172-281 563 2?.3-47 5-113 2-283 34-7 23-71 569 
571 2?.11-133-191 2-7-41 52-23 28.32 577 D177 3-193 
7-83 2-3-97 11-53 23-73  3?-5-132-293 587 22.3.72 19-31 
3-197 24.37 593 2-33-11 5-7-17 27-149 3-199 2-13-23 599 
601 2-7-43 32-67 27-151 5-112 2-3-101 607 25.19 3-7-29 
13-47 27-32-17 613 2-307 3-5-41 23-7-11 617 2-3-103 619 
33.23 2-311 7-89 24.3-13 54 2-313 3-11-19 2-157 ~=—-:17-37 
631 23.79 3-211 2-317 5-127 2?-3-53 72-13 2-11-29 32-71 
641 2-3-107 643 2?.7-23 3-5-43 2-17-19 647 23.34 11-59 

27.163 653 2-3:109 5-131 24-41 37-73 2-7-47 659 
2-331 3-13-17 23-83 5-7-19 2-32-37 23-29 27-167 3-223 
11-61 2°-3-7 673 2-337 33.52 22.132 677 2-3-113 7-97 
3-227 2-11-31 683 22.37.19 5-137 2-73 3-229 24.43 13-53 
691 22.173 32-7-112-347 5-139 23.3-29 17-41 2-349 3-233 
701 2-33-13 19-37 26-11 3-5-47 2-353 7-101 2?-3-59 709 
37-79 23.89 23-31 2-3-7-17 5-11-132?-179 3-239 2-359 719 
7-103 2-192 3-241 27-181 52-29 2-3-112 727 23.7-13 386 
17-43 2?7-3-61 733 2-367 3-5-7? 25.23 11-67 2-37-41 739 
3-13-192-7-53 743 23.3-31 5-149 2-373 37-83 22-11-17 7-107 
751 24.47 3-251 2-13-29 5-151 2?-33-7 757 2-379 3-11-23 
761 2-3-127 7-109 27-191 32-5-172-383 13-59 28-3 769 
27.193 773 2-37-43 57-31 23.97 3-7-37 2-389 19-41 
2-17-23 33.29 24.72 5-157 2-3-131 787 27.197 3-263 
7-113 23.37-1113-61 2-397  3-5-53 22-199 797 2-3-7-19 17-47 
32-89 2-401 11-73 2?-3-67 5-7-23 2-13-31 3-269 2°-101 809 
811 22.7-29 3-271 2-11-37 5-163 24-3-17 19-43 2-409 32-7-13 
821 2-3-137 823 23.103 3-52-112-7-59 827 22.32.23 829 
3-277 28.13 77-17 2-3-1389 5-167 2?-11-193°-31 2-419 839 
29? 2-421 3-281 27-211 5-132 2-37-47 7-112 24.53 3-283 
23-37 2?-3-71 853 2-7-61  32-5-1923-107 857 2-3-11-13 859 
3-7-41 2-431 863 25.33 5-173 2-433 3-172 22-7-31 11-79 
13-67 29-109 37-97 2-19-23 53.7 2?-3-73 877 2-439 3-293 
881 2-32-72 883 2?.13-17 3-5-59 2-443 887 23.3-37 7-127 
34.11 27.223 19-47 2-3-:149 5-179 27.7 3-13-23 2-449 29-31 
17-53 2-11-41 3-7-43 23-113 5-181 2-3-151 907 27.997 = 32-101 
911 2*.3-19 11-83 2-457 3-5-61 27-229 7-131 2-33-17 919 
3-307 2-461 13-71 2?-3-7-115?-37 2-463 37-103 25-29 929 
77.19 27.233 3-311 2-467 5-11-17 23-32-13 937 2-7-67 3-313 
941 2-3-157 23-41 24-59 33.5-7 2-11-43 947 2?.3-79 13-73 
3-317 23-7-17 953 2-32-53 5-191 27-239 3-11-29 2-479 7-137 
31? 2-13-37 32-107 22-241 5-193 2-3-7-23 967 23.112 3-17-19 
971 22.35 7.139 2-487 3-52-1324.61 977 2-3-163 11-89 
37-109 2-491 983 23.3-41 5-197 2-17-29 3-7-47 22-13-19 23-43 

99_|2-32-5-11991 25.31 3-331 2-7-71 «5-199 2?-3-83 997 2-499 33.37 

100_|23.5% 7-11-13 2-3-167 17-59 27-251 3-5-67 2-503 19-53 2*-37-7 1009 

101_]2-5-101 3-337 27-11-231013  2-3-13?-5-7-29 2%-127 37-113 2-509 1019 

102_]2?-3-5-171021 2-7-73 3-11-31 219 52-41 2-33-19 13-79 22.257 3-73 
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1.8.12 EULER TOTIENT FUNCTION 
1.8.12.1 Definitions 


@(n) the totient function, is the number of integers not exceeding and relatively 


prime to n. 


a(n) is the sum of the divisors of n. 


T(n) is the number of divisors of n. (Also called the d(n) function.) 
Define o;,(n) to be the k" divisor function, the sum of the k"" powers of the divisors 


of n. Then T(n) = oo(n) and o(n) = o4(n). 


EXAMPLE The numbers that are less than 6 and relatively prime to 6 are {1,5}. Hence 


(6) = 2. The divisors of 6 are {1, 2,3, 6}. There are 7(6) = 4 divisors. The sum of 
these numbers is 0(6) = 1+2+3+4+6=12. 


1.8.12.2 Properties of the totient function 


1 
2. If pis prime, then ¢(p) = p — 1. In general, é(n) = MTToin (1 —=). 
3. 
4 


. dis a multiplicative function: if (n,m) = 1, then d(nm) = d(m)¢d(n). 


1 





P 
Gauss’ theorem states: n = )7q),, O(a). 
. When n = |], p;'', and the {p;} are prime 
k pr a4 
ae -I-G- (1.8.15) 
Generating functions 
> n(n) > o(n) _ ¢(s = 1) 
= —k = 1.8.1 
2d ~ 3 = 6(s)C(s — k) 2d me ey 8-16) 


A perfect number n satisfies o(n) = 2n. The integer n is an even perfect 
number if and only if n = 2™~1(2™ — 1), where m is a positive integer such 
that /7,,, = 2"” — 1 is a Mersenne prime. The sequence of perfect numbers is 
{6, 28, 496, ...}, corresponding tom = 2, 3, 5,.... It is not known whether 
there exists an odd perfect number. 


1.8.12.3 Table of totient function values 
n on) tin) o(n)[ n on) r(n) o(n)] n b(n) T(n) o(n)[ n 6m) 7m) o(n) 
1 0 1] 2 3| 3 2 7 





2 
4 
4 
8 
8 


12 


ConRnRo RRORR DARREN 


3 
4 
6 
5 
6 
8 
6 
6 
9 
8 
6 
0 
6 
8 


1 
2 
3 
2 
2 
4 
3 
2 
4 
2 
2 
6 
a 
2 
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1.9 SERIES AND PRODUCTS 


1.9.1. DEFINITIONS 


If {a} is a sequence of numbers or functions, then 


1. Sy = Sy An = A, + a9 +... + ay is the N"™ partial sum. 
2. For an infinite series: S = limy_.., Sn = St Gn (when the limit exists). 
Then S is called the sum of the series. 








3. The series is said to converge if the limit exists and diverge if it does not. 

4. If a, = b,x", where b,, is independent of x, then S is called a power series. 

5. Ifa, = (—1)"Ja,|, then S' is called an alternating series. 

6. If }> |an| converges, then the series converges absolutely. 

7. If Sy converges, but not absolutely, then it converges conditionally. 

EXAMPLES 

1. The harmonic series S = 1+ 3 + s +... diverges. The corresponding alternating 

series (called the alternating harmonic series) S = 1—$+4—---+(-1)""*44... 


converges (conditionally) to log 2. 


1 5 
2. The harmonic numbers are H, = b ke The first few value are {1, 3, 4, 2, seat 
k=1 


Asymptotically, H, ~ Inn +7+ x. 


N 1 —_Nt 
n=0 


1.9.2 GENERAL PROPERTIES 


1. Adding or removing a finite number of terms does not affect the convergence 
or divergence of an infinite series. 


2. The terms of an absolutely convergent series may be rearranged in any manner 
without affecting its value. 


3. A conditionally convergent series can be made to diverge or to converge to any 
(finite) value by suitable rearranging of its terms. 


4. If the component series are convergent, then 


S (aan =P Bby) =a > An + B \ by. 
5. Ss | (>: | a 3 Cn Where Cyn = Agdn + a1bn—1 +-+- + anbo. 


n=0 n=0 
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6. Summation by parts: let }> a, and > 6, converge. Then 
» Anbn = s Sin (bn — bn+1) + (boundary terms) 


where S,, = )> dy is the n™ partial sum of the {a,,}. 


7. A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 


8. Schwartz inequality: 


2 lan| |On| < oF lanl?) o fal?) 


9. Holder inequality: when 1/p+1/q=1andp,q>1 


Elvb < (Shah) (Spa) 


10. Minkowski inequality: when p > 1 


(~~ lan +b, < (~~ lanl?) a (x bal)” 


11. Arithmetic mean—geometric mean inequality: If a; > 0 then 


ai +agt+...+@n 
n 


S(awg*<e,y 


12. Kantorovich inequality: Suppose that 0 < #1 < #2 <<... < ay. If Ay > 0 
and )>."_, A; = 1 then 


Xi a 
where A = 4 (z1 + Z,) and G = ./21En. 


EXAMPLES 


1. Let T’ be the alternating harmonic series S rearranged so that each positive term is 
followed by the next two negative terms. By combining each positive term of T’ with 
the succeeding negative term, we find that T31 = $92 n. Hence, T' = s log 2. 


2. The series 1 +4 3 3 t+ etet+e z +... diverges, whereas 


ee ee ae es ee ae ae 
3. 2 5 7 A 4n—3 4n—1. 2n < 


converges to log(2V/2). 
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1.9.3 CONVERGENCE TESTS 


if 


2. 


Comparison test 

If |an| < bn and >> b, converges, then > an, converges. 

Limit test 

If jim, dn # O, or the limit does not exist, then S Gn, 18 divergent. 


Ratio test 





. If p > 1, the 


series diverges. 
Cauchy root test 


Let o = lim |a,|1/”. Ifo < 1, the series converges. If o > 1, it diverges. 
noo 


Integral test 





Let |a,| = a ) with f(a) being monotone decreasing, and limz_,.. f(x) = 

0. Then es 4 f(x) dx and >> ay both converge or both diverse for any A > 0. 

Gauss test a 

If = 1 ie at ae —, for sufficiently large n, where g > 1 and the 
An+1 





sequence {A,,} is ound: then the series is absolutely convergent if and 
only ifp > 1. 

Alternating series test 

If |a,,| tends monotonically to 0, then )>(—1)"|a,,| converges. 


——lo n 1] Tm 
If a; > Oand a = hm—-— ss and B = lim~©~ ? 
logn logn 





then we can apply the test 


e ifa < —1 then }> a, converges 
e if 8 > 1 then a, diverges 


EXAMPLES 


1. 


For S$ = 0°, n°a”, p = limn40(1+ +)°x = x. Hence, using the ratio test, S 
converges for |z| < 1 and any value of c. 


For S =o, ra c= litineveo( 5)” = 5. Therefore the series diverges. 
For S = 0°°_, n‘, consider f(x) = x~*. Then 


1 
a ~d eT fort > 1 
/ fle) de = [ “= Caw r 
1 1 diverges fort <1 
Hence, S converges for t > 1. 
The sum >>, wloeny? converges for s > 1 by the integral test. 
a Dai -1 . ee 
Let an = as = ores Lie aa ee where c is not O or a negative integer. 
n) n 


ie «fen 
n+c 


Then 














) . By Gauss’ test, the series is absolutely 
An4+1 
convergent if and only if c < 0. 





. iSace _ ei 1)” (—1)" 
The series : — diverges while the series converges. 
= vant (=) 


n= 4vn-1 
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1.9.4 TYPES OF SERIES 


1.9.4.1 Power series 

1. The values of x, for which the power series par Gdnx” converges, form an 
interval (interval of convergence) which may or may not include one or both 
endpoints. 

2. A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 

3. Note that [1 + 30°, anw™)~* = 1— 3, bane”, where b} = a and b, = 
Gn + —S) bn—Kar forn > 2. 

4. Inversion of power series: If s = bear Gnx”, then x = baci A,s”, where 
Ay = 1/a, Az = —a2/a3, Az = (2a2 — a,a3)/a?, Ag = (5010203 — afa4— 
5a3)/at, As = (6azaga4 + 3a7a2 + 1405 — atas — 21a,a3a3)/a. 


1.9.4.2 Taylor series 


1. Taylor series in | variable: 


ye) 
flata)=y Oe 4 Ry 





n=0 
fle) = Fla) + Fea) + LQ @— a)? + Fea +... 


or, specializing to a = 0, results in the MacLaurin series 


fe) =F) + FOr+LOe, LO oy 


2. Lagrange’s form of the remainder: 


get 
(N+D! 
3. Taylor series in 2 variables: 


Ry = ae fin (a+ 6x), forsome 0<6 <1. 


f(a - x,b+ y) = f(a, 6) FE x f(a, b) sa yfy(a, b)+ 

1 
oN |e” feu(a b) + 2ry fry(a, b) vv lei (a, b)| + 
4. Taylor series for vectors: 


N n 
fats = 57 ee w"le@) + Ry(a) = f(a) +x-Vf(a)+ 


n! 








n=0 


EXAMPLE 


+1 na, v—-n 
e Binomial series: (x + y)” => Toon t} a 
v—n n! 


When r is a positive integer, this sete terminates at n = v. 
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1.9.4.3 Telescoping series 
If limp oo F(n) = 0, then $7, [F(n) — F(n + 1)] = F(1). For example, 


[o<) 


- 1 1 
i cwsnces) CERES -~[- —|- 





(1.9.1) 


en 


The Wilf—Zeilberger algorithm expresses a proposed identity in the form of a tele- 
scoping series }>,[F'(n + 1,k) — F(n,k)| = 0, then searches for a G(n, k) that 
satisfies F(n + 1,k) — F(n,k) = G(n,k + 1) — G(n,k) and G(n, +00) = 0. 
The search assumes that G(n,k) = R(n,k)F'(n,k — 1) where R(n, k) is a rational 
expression in n and k. When R is found, the proposed identity is verified. 


- 2k ,_ {2 
e The identity S- (—1)* (1) ( , ie = (*") has the proof 





R(n,k) = k(n — 1). This is equivalent to 
F(n, k) = (-1)™(?) (7*)4"-* /(2") and G(n, k) = R(n, K)F(n, k — 1). 


Ey 


2 
2n 2 ; 

e The identity Xe Hu ) = ( ") has the proof R(n, k) = a: 

e The Pati Saakschutz identity: 





(b+k)(a+k) 


has the proof Rin, k) = ~(e—btn+1)(c—-atnt+l) 





1.9.4.4 Dirichlet series 
These are series of the form )>~~_, “x. They converge for x > x, where xq is the 


abscissa of convergence. Assuming the limits exist: 


1 shh, 
1. If > a, diverges, then zp = lim a Sica 


N00 logn 
] sas 
2. If }> ap converges, then v7 = lim — 
EXAMPLES 
1. Riemann zeta function: ¢(x a =, 0 = 





= 1 
2 2 u(r) = =~, to=1 (p(n) denotes the Mobius function; see page 36) 


~d 
3. ) a] = C7 (x), xo =1  (d(n) is the number of divisors of n; see page 46) 
me 
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1.9.4.5 Hypergeometric series 


The hypergeometric function is 
a, a a \ (a1)n(a2)n--- (Gp)n 2” 
F Plig|= Oe 1.9.2 
P ( bi be c) dX (b1)n(b2)n--- (Bq)n_ 7! wee) 


where (a), = I'(a+n)/T(a) is the shifted factorial. Any infinite series }* A,, with 
An+1/An a rational function of n is a hypergeometric series. These include series 
of products and quotients of binomial coefficients. 











EXAMPLES 
a, b _ P(e)(e-a—b) 
0 of c 1) a iMe—all(e—8) — a)F(e=5) (Gauss) 
—n, a, b _ (€—a)n(e— b)n 
e 3f) . a a 2) a @4c= 1-9. a= 5), (Saalschutz) 
1.9.4.6 Other types of series 
N 
: : ‘ 1 
1. Arithmetic series: Si(a +nd) = Na+ aN(N +1)d. 
n=1 
2. Arithmetic power series: 
N 
_ bN)aN+1  ba(1 — aX 
S (at nb)a” = Ae ee) esi, 
l-« (1-2) 
n=0 
: ; 2 3 1 
3. Geometric series: ltoetartarte = ; (|2| < 1) 
—2 
4. Arithmetic—geometric series: 
b 

a+(a+b)r+(a+2b)x?+(a+3b)a°+---= — Toap Pore <1). 

5. Combinatorial sums (x can be complex): 


oS )=C5) 

(b) Low) = (-1)" & a ‘) 
ob Cr) 
@ Seole)=() 


@) = Crea) (n is ~ (rin) 
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©) > Oe er ~ eee 


OECD) =< (CL) omen 


6. Generating functions: 











(a) Bessel functions: 77°. Je (x)z* = exp($a==) 

(b) Chebyshev polynomials: 377~_, T(x)z” = pee 

(c) Hermite polynomials: }>>~_, Hal) 2” = exp(2rz — 27) 

(d) Laguerre polynomials: $>7~ 5 LO (a )e™ = (1— z)~* 1 exp[“4] 

(e) Legendre polynomials: )y7° 9 Pr (z)x” = = for |a| <1 


7. Multiple series: 
(- yee 


@ > (+1/6)2+(m+1/62+(n+ 1/6) 


where —oo < 1,m,n < oo and they are not all zero 





il 
(b) pay me + al = 48(z)¢(z) for —oo < m,n < oo not both zero 
y" T(n+ 1/2) 4 port (/% = 2) 
e Pe Timtat iy Vag A> 
m? — n? WT 
) » (m2 + n?)2 27 | 
m,n= i 


1 en 

a Sef 1<k <it+<kn< 

© 2 @e..2 gap sh . 

8. Lagrange series: If f(z) is analytic at z = zo, f(zo) = wo, and f’(zo) £0, 
then the equation w = f(z) can be inverted to obtain the unique solution 
z = F(w). If both functions are expanded 


f(z) = fot falz — 20) + fo(z — 20)? +... 





; (1.9.3) 
F(w) = Fo + Fi(w — wo) + Fo(w — wo) +... 
with Fo = F(wo) = z, then 
ee eee (1.9.4) 
7 jl | dzi-! | f(z) —- fo _ 
Z=Z0 





1 2f2 — 
For example: F) = —, fy = fa F3 = ofa — Als er 


fi fi f? 


54 CHAPTER 1. NUMBERS AND ELEMENTARY MATHEMATICS 


1.9.5 FOURIER SERIES 


If f(x) is a bounded periodic function of period 2L (that is, f(a +2L) = f(x)) and 
satisfies the Dirichlet conditions, 
1. In any period, f(x) is continuous, except possibly for a finite number of jump 
discontinuities. 
2. In any period f (2) has only a finite number of maxima and minima. 


Then f(a) may be represented by the Fourier series, 
NTx 
> i bn M3 1.9.5 
ae (2 cos a4 sin —— 7 ( ) 


where {a,,} and {b,,} are determined as follows: 


iL po nx 
an =z if f(x x) cos —— da forn =0,1,2,..., 
or 
=z / f(x) cos de, (1.9.6) 
= 1 seta 
1 a+2L 
=z f f(a) sin = dex forn = 1,2,3,..., 
1 pe 


==/ f(z ee (1.9.7) 


0 
— a f(a ) sin — — * de, 


where a is any real number (the second and third lines of each formula represent 
a = 0 anda = —L, respectively). 
The series in Equation (1.9.5) will converge (in the Cesaro sense) to every point 


fat) + f(@) 
2 


and right-hand limits) at every point where f(a) has a jump discontinuity. 


where f(z) is continuous, and to (i.e., the average of the left-hand 


1.9.5.1 Special cases 
1. If, in addition to the Dirichlet conditions in Section 1.9.5, f(x) is an even 
function (i.e., f(a) = f(—«)), then the Fourier series becomes 


0 - NTX 
scl S = seta 1.9.8 
+ Gn COS Z ( ) 


n=1 


That is, every b,, = 0. In this case, the {a,,} may be determined from 


a 7” 
a=z if f(z)cos de n=0,1,2,.... (1.9.9) 
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If, in addition to the above requirements, f(x) = —f(Z — x), then a,, will be 
zero for all even values of n. In this case the expansion becomes 


of 
=> ji, ~— es (1.9.10) 
2. If, in addition to the Dirichlet conditions in Section 1.9.5, f(a) is an odd func- 
tion (i.e., f(a) = —f(—«)), then the Fourier series becomes 
‘ a0 sin —~. (1.9.11) 
n=1 L 


That is, every a,, = 0. In this case, the {b,,} may be determined from 
hee f(a) sin = de n=1,2,3,..-. (1.9.12) 
0 


If, in addition to the above requirements, f(x) = f(Z — 2), then b,, will be 
zero for all even values of n. In this case the expansion becomes 


i 
a Pe lial LE “— ae (1.9.13) 


m=1 


The series in Equation (1.9.10) and Equation (1.9.13) are known as odd har- 
monic series, since only the odd harmonics appear. Similar rules may be stated for 
even harmonic series, but when a series appears in even harmonic form, it means that 
2L has not been taken to be the smallest period of f(x). Since any integral multiple 
of a period is also a period, series obtained in this way will also work, but, in general, 
computation is simplified if 2 is taken as the least period. 

Writing the trigonometric functions in terms of complex exponentials, we obtain 
the complex form of the Fourier series known as the complex Fourier series or as the 
exponential Fourier series. It is represented by 














\ ao (1.9.14) 
nT : 
where Ww, = Tr forn = 0,+1,+2,... and the {c,,} are determined from 
i 
Cn = oF /. flaje"* da. (1.9.15) 


The set of coefficients {c,,} is often referred to as the Fourier spectrum. 
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1.9.5.2 Alternate forms 
The Fourier series in Equation (1.9.5) may be represented in the alternate forms: 


1. When 6, = tan—!(—an/bn), Qn = Cn 8iN bn, bn = —Cpn COS dn, 


and cy, = \/a2 + 62, then 


i@= 904 Son sin (= + dn). (1.9.16) 


n=1 


2, When d, = tan—"(an/by),dn = Cy Sindy, Dn = Cp COS Op, 


and c, = \/a2 + 62, then 


_ ao ~ nna 
f@)=5 ~ cos (= +n). (1.9.17) 
1.9.5.3 Fourier series 
1. If f(x) has the Laplace transform F'(k =\ e—** f(x) da, then 
1 [*  cos(t) —e7* 
F(k (kt) —_ a1 —_ f (x) d: 
yr vent =3/ cosh(a a pi) 
oo A (1.9.18) 
 — sin(t) f(a 
> F( F(k) sin(kt) >| ae) dx. 
— ~ 3 9 cosh(a) — cos(t) 
 sin(2n72) (=i Lh" (29)2""* : 
2. > = eet = 5) FT Baws), for0O<a< 3 
. cos(2nmz) (—1)*-1 (2r)?* ‘ 
3. 2 nek Se (2h)! Box(x) for0< a < $ 
7 asin(x) 
4. ye sin(nx) ecco ype for ja] < 1 
= — acos(x) 
‘ ° —_______"" _ f 1 
5 ae cos(nz) = i — yta or jal < 


(a) l= ne ae a + (0<a<L) 
ogg ta. ye ge oe e 
1.2 1 
w) 2-2 |s =-5 oe +S sin 4 ee tar 
AL i. 3 1 6 
@2=5-5| i gee an (0<2<L) 
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‘S L? L? TL 20x x 1 30 1 Ana r 
e) x s cos — cos s 
3 7 L 22 L 3? L 4? L 
(-—L<a<L) 
T 11 1 
eg ee eee oe 
© a, 2. oO 
T 1 1 1 1 1 1 
szelt+antatpmt =H=2ll-sta wt: 
() prt p ( 7 32 ge ) 


1.9.5.5 Expansions of basic periodic functions 
Sx) 
A 





































































































9 ed —1)" ' 
(a) fey=£42y>5 1) sin cos IF = : << | 
n=1 0 {fe 
L 2L ox 
Sx) 
4 il A 
(b) f(x) = = = sin = ! 
a n=1,3,5,... a ; 7 ee 
Sx) 
=. (-1) 4 ee 
2 —1)” nrc | nner if 7 
(c) f@)=—)>) . (cos ~ 1) sin —— ; = 
n=l L QL ‘x 
Laie ig a 
Sx) 
A 
2— nm sin (nwc/2L) nTx Vd 
d 2 —— sin — 3 
(@) F(x) L ae nie/2L aeat 3 —— =e > 
I/ceh eee 
, 4ynl nt, nwa . 
(e) f(x) == 7 Sin Sinnma sin — (a= =F) 
= foo 
c <— 
1 
TL 
i L/4 L “ToL x 
I 
geile = 
Sx) 
1 ill . noe 
(f) {== — >) : 
n=1 t > 
wm x 
fx) 
1 4 a NTx 
(g) so aa ee z C08 
ae n=1,3,5 0 | | | |_p 
: 2L x 
l+a 2 | - nTx “ 
(h) {@)=—"+aq-a Le [(—1) cos na — 1] cacao (a= sr) 
a fx) 
ee >| 


0 + + > 
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‘ 1 4 1 NTx 
G@) f(x) = on == 2a) 2 72 cos na cos aa (a = ora 
NH=1, 355005 fo) 
ee | 
ar) L W-c2 on 
: 2 (-1)""1 sin na nna 
aS le Ss 
GQ) f(x) 2 Ps + nal 2) sin L (a + 
“— fx) 


>| /2 | 









































: L OL : 
1 
—r| c2 le 
2 (=1)""" Lee(=1)" . ane 
(k) f@)=2y OO" [i+ REO inna sin = (a=¢ 
= fo) 
| c/2 
1 
2L-c2_, 
i o2 L es 
I 
—»| 2 le 
SQ) 
co n+1 
(l) f(a) =2 >>! Dig F a 
n=1 4 
al — > 
fix) 
8 1)-D/2 nTx 
(m) f(x) = a) Ch) 5) — ! 3L/2 
T A n 0 a 
N=1,3,5 50.5 L/2 L ae . 
a4 
91 . nt. nre L 
(n) f(2)=3 yD 72 Sin sin 5L/3 2b 
u uy 3 L 0 + 1 i_»> 
= LB L ks 
fo 
32 Slo. ont. nee - 
as 2g Oy \ 
aor L/4 L : 
1 1 2 1 
(p) f(x) ==—+ ssinwt—— a —— cos nwt 
nm 2 Tce el 
i Aix) 


sin wf T= 2n/@ 





n/a 2n/m t 
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1.9.6 SERIES EXPANSIONS OF SPECIAL FUNCTIONS 
















































































1.9.6.1 Algebraic functions 
(g+y)" = ee n gr ty + n ga de a. 
1 2 
(l4a)"=1+ (T)a+ (Se ae (5) tee, (a? < 1). 
1 +2 
(lta) "=1F (Te ("3 ers ¢ )e+. ; i <p), 
Vl+a2= a =x? 4 Js Ay (x? < 1) 
2 16 128 “ 
3 5 35 
1 =i/8 2 Se ae oe a ee ee 1), 
(1+ 2) w+ ou 16° + F598 Se (a* < 1) 
(ltc)t=1Fe4e2? Fei +a*F a +.. ; (x? < 1). 
( +a)~? =1 5 2c 4 30? = 4e? + 5a4* F 60° 4+..., (x? < 1). 
1.9.6.2 Exponential functions 
ee 1 
eT a et 
2 n 
ef =1+5 Ste ttn, (all real values of x) 
! 2! n! 
14S Sussteesieees 
aa 2. nile nn+1—2) x not a positive integer 
_ 2 fares n 
=e fi+@-a+© a) ook a +... 
2! n! 
bas (x log, a)” (xlog, a)” 
a = 1+ elog.a+ 5, —_ a +: 
(all real values of x) 
1.9.6.3 Logarithmic functions 
=i I featy\* 1 fe=—1\" 
1 1 
= (e=1)- 5-1)? + 5(e-1)8 -..., (2>2>0), 
x-1 1fa-1 vd x—-1 an (x > 0) 
= = = So x : 
xtl 3\241 5\at+l , 
(x-—a) (x-—a)? (x-a)3 
= loga [as 3g (0 <a < 2a). 
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a ee 

oS =e ee a, = 21), 

log(l+2)=2 = a rt ; (=lL<e< 7) 
a 1 1 

loge il) = logy = 1) 4 2 | Sh tel « (a > 1). 
x 3x 5x 

x 1 x ae | x 
1] =] 2 |——_ + = = bh 
og(a +a) = loga+ a t3 (as) +3 (55) + | 





(a>0,-a< 2). 





1 3 
log a ee ee (-l<2z<)). 


1-2 3 2n—1 


1.9.6.4 Trigonometric functions 








. 2. ge gt 
sing =x — a tata te (all real values of 2). 
2 4 6 
cosx =1—- a + 7 - a +.... (all real values of x). 
7 27° (—1)-2 oO" _ 1) Bo 
i = a te ay a 
pe ge gee cea (Qn)! —— 


2 
(a? < i and B,, is the n'" Bernoulli number). 





g @ 2% gf (=1)"""0""B5, oen4 
cot® =—-- = — — — -...+ seas 
3. 45 945 4725 (Qn)! 
(x? < 1? and B,, is the n Bernoulli number). 
a 5 61 277 (—1)" Ey 
=] eae J pt eee Oe 8 . ATs en On 
Sec © =P a ga” + Za9” + 3064" ss a Qn)! x 
(a? < = and E,, is the n“* Euler number). 
1 Tx? 312° —1)"+12(2?"-1 _ 1) Bo, 
es = + es 4. Boe Be 


26 360’ 15120 (2n)! 


oe 


(x? < 1? and B,, is the n Bernoulli number). 


2 4 6 











; x x x 2 2 
log sinx = logx = Gag oe (x <0 
ine a a ames ee 2. 
OBCO8E =F 19 45 3520 ae 
fase 1 ote" Gla" 9 
og BE = OS a Gn) aaae Vo (x Star 

oe (c-a)? .  (w—a) 

sinx = sina + (x — a) cosa — ~——— sina— cosa+.... 


). 


). 
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1.9.6.5 Inverse trigonometric functions 


1-3-5 
sin-ta =a+——2?4+ et Cieeew 


523 2-4-5 ee ae 


Tw - —1 wT 
(a? <1,-3 <sin™*« < 4). 
7 a Ay A gg I oe, 
cos heeled — ———— per eerrreemenet F eeope 
FAY 9.3 ' Od. DAG 


(a? <1,0<cos''x2 <7). 

















3 5 27 
tante 2-4 t.. (ge? <1), 
nr dl 1 1 1 
=—-——-4+2— 5-72 ++ 2>5-... > 1), 
2 < og 5a = Tat @ ) 
nr 1 1 1 1 
=--— —_ ¢ <—-1). 
2 eo oe 5a® Tat ) 
3 5 7 
cot te =F-@t+ StS H... (x? < 1). 
1.9.6.6 Hyperbolic functions 
; ge fa at g(2n+1) 
inh 2 3 h sin x Senay panes (cee 
Ss = —sinhza | ——- —- ———- + ——_— x ; 
ao 7 a2+12 @g#1+22 g2+32 
a ot 78 gen 
he=l+o—4—4—+4:--4+—4.... 
cosh x vor a Be ™ Gal” 
h 2a, h 1 cos x 4 cos 2x cos 3x 4 dich oa 
coshazx = — sinhza| — — ———~ + ——_~ - ——— ks . 
T Qa a2 +12 a? +22 a? +3? 
1 2 2h 2® — 1) Ban, 2n-1 T 
=f ade 406-9 296-4 (Re x > 0), 
1 1 1 
= 2a T 2 3r\2 2 52 \2 2 
(SG) te (yer (ay +e 
1 a 2 2% 22” Bo 
tha =—+=——-—~—+-——+::: Le el 0 <7), 
Oe aa a a ee ae eem 





=[406 7492" 496 +... (Re x > 0), 
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h 1 1 61 
sech 2 = ar aris eas eT eat 





(|z| < 4, Ey is the n™ Euler number), 





a (e-* -e Po g-O® — 6 4) (Re x > 0), 
a EF ecg ie 1 

6 360 (2n)! 
a (e © ge 1 ge Bp T+.) (Re x > 0), 


(eZ) 


sinh nu = sinh wu [(2 cosh u)"~* — 7 


+ See Sn =a (2coshu)”~° 
_ (n—4)(n—5)(n — 6) 
3! 

[2 cosh u)"-F(2 cosh u)"~? + 


_ n(n—4)(n—5) 
3! 


Aes (0 < |a2| < 7), 








(2coshu)"~7 +... ‘ 


Mn 9) (2 cosh u)"~4 


(2coshu)”~® + .. ‘| . 


coshnu = 


Nle 


1.9.6.7 Inverse hyperbolic functions 





1 ie 1-3-5 
el se atop 3 5 7 1 
a Y—o.g" “Saas POT el), 
11 1-3 1 3-5 1 
HWE) 5° Se Sea dak Ide Ba clea 
2 i i. ae 4 
cosh teat pe (x > 1). 


1 1 1 1- 1 1-3- 1 
eet 











x 2 373 2-4 5rd 2-4-6 Ta? 
1 @% 1-3 at 1-3-5 2 
loo Se Se Ss 0 1). 
2 2 2-4 A DAG 6 ven) 
2 1 2? 1-3 at 1-3-5 2 
a se yr eg ig O<s 1). 
ee eee Se ed A A OG ae 
3 5 7 2n+1 
tanh Sat Sets: matt (jx| < D. 
re 1 1 1 
cot eas bas et ee (|z| > 1). 
1 Ean, 
gdz=a2——2° ee +: an gant (ja| < 1). 


6 24 * Gn+D! 
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1.9.7, SUMMATION FORMULAS 


1. Euler—MacLaurin summation formula: Asn — , 
1) )~ Shr + fr f(x dv +04 (-1 yt LO 
k=0 g=1 : (J =e 1)! 
where B; is the j" Bernoulli number and 
C= lim y(-1¥B, £0) + * £(0) 
a I+17- 2 


aa l= (j+1)! 


2. Poisson summation formula: If f is continuous, 


0) +2 Fn) = _ f(x) ae +29 i f(z) cos(2nmz)e| : 


n=1 


3. Plana’s formula: If f is analytic, 


fPtD (n ) 


yo 10 nyt [tte yao + By 


where a is a constant dependent on f and B; is the j ‘h Bernoulli number. 


EXAMPLES 
1 a logn+7y+ . Hs where ~+y is Euler’s constant 
ie =e mr == «=e 7 “ 
d. KENT YT On Bn? i 
ea 2 T oe Dt Be7 
2.142) e"*=4/—|142) -e 7" bi 
+ a" - ae z e€ | (Jacobi) 





1.9.8 FASTER CONVERGENCE: SHANKS TRANSFORMATION 


Let s,, be the n™ partial sum. The sequences {$(s,)}, {S(5(sn))},-.. often con- 
verge successively more rapidly to the same limit as {s,,}, where 





2 
Sn4+1$n—-1 — Sy 
S(s_) = ——— ~~. 1.9.19 
o ) Sn41 + 8n-1 — 28n ‘ 
“ : 1 
ee kk : - 
EXAMPLE Fors, = y (—1)"2", we find S(s,) = Te for all n. 


k=0 
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1.9.9 SUMMABILITY METHODS 


Unique values can be assigned to divergent series in a variety of ways which preserve 
the values of convergent series. 


co co 
1. Abel summation: s apn, = lim y ann”. 
r>l1- 
n=0 n=0 


co 
2. Cesaro (C, 1)-summation: = im mo 
00 + 








n=0 
where s,, = pee Gm are the partial sums. 
— 1 Bak p(2h-1) 

3. Ramanujan summation: > f(k) = —5F(0) - > era (0) where 

f(2*-) is the (2k — 1)" derivative of f and By, is the 2k" Bernoulli number. 

EXAMPLES 

el-141-1+---= 4 (in the sense of Abel summation) 
e 1—14+0+4+1-14+041--:-= 3 (in the sense of Cesaro summation) 
eo 1424+3+4---= — =-3 (using f(a) = a in the Ramanujan formula) 








1.9.10 OPERATIONS WITH POWER SERIES 
Let y = aiz + agar? + agz> +..., and let z = z(y) = bia + box? + dsr? 4+... 


a? + 2a,a2 + a3 
123) 1 1 
Tet — 74142 + 543 


Gis aes 1 
7g + 7142 = 343 
rac + a1,a2 + ag 
a3 — a4a2 + sa} 

13 
mer aeal + a3 








1.9.11 MISCELLANEOUS SUMS 


1 mw td 
. k=1 k(k+1)(k+2) 4 2(n+1)(n+2) * 





2. ae REED Ep a io 
= 1 

3. Ses; a, ES RD 
» k log k(log log k)? 


: : 1086 ; 
naive summation more than 10°! terms are needed for two-decimal places. 


converges to 38.4067680928... very slowly. Using 


- 1 
4. d hloek(ogiogh) diverges, but the partial sums exceed 10 only after a 


googolplex of terms have appeared. 
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1.9.12 INFINITE PRODUCTS 


For the sequence of complex numbers {a;}, an infinite product is []7-,(1 + ax). 
A necessary condition for convergence is that limp—+oo dn = 0. A necessary and 
sufficient condition for convergence is that 4 log(1 + ax) converges. Examples: 




















oo ice) 2 
(a) sinz = 2] cos (d) sinhz =z || (1+ 7 
k=1 k=1 
, _ 2 7 42? 
(b) sinaz = tM (1 _ =) (e) coshz = iu (1 = (2k + ra 
= 42? 7 (1 + kD. 
(c) osm = T] (1-5) (f) sae ara sg 
k=1 k=1 
. —_ : | z 
(g) sin(a + z) = (sina) Li (1 side 7 =) 
k=0,+1,+2,... 
iacig-ce TT fe 
~ pe ae 2a+ kr 














1.9.12.1 Weierstrass theorem 
2 m 
Define E(w,m) = (1—w) exp | w + le rere Pa 
2 m 


be a sequence of complex numbers such that |b;,| — oo. Then the infinite product 
[o<) 





. Fork = 1,2,... let {by} 


z d : : F ‘ 
P(z) = i E (=. k) is an entire function with zeros at b; and at these points 
ke 
k=1 


only. The multiplicity of the root at b,, is equal to the number of indices 7 such that 
b; = bn. 


1.9.13 INFINITE PRODUCTS AND INFINITE SERIES 


1. The Rogers—Ramanujan identities (for a = 0 or a = 1) are 


gk tak 


1+ 2a) 


1 


Ul (1 — qbitatt)(] — gbi—a+4) 


(1.9.20) 


2. Jacobi’s triple product identity is 


CO Co 


S> get =]Ja-@)a+e%~)+eg). 0.9.21) 


k=—0o j=l 
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2.1 ELEMENTARY ALGEBRA 


2.1.1 BASIC ALGEBRA 
2.1.1.1 Laws of exponents 


Assuming all quantities are real, a > 0, b > 0, and no denominators are zero: 


acd = arty, on at, (ab)” = ab, 
ay 
0 _ —2 1 a\* = a* 
a= ie a — 7? ca fem oe 
at b be 





2.1.1.2 Proportion 


if? = ©, then 




















b 6d 
a+b ct+d a—b c—d a—b cd 
e => e = e = 
b d a+b ctd b d 
a b 
e ad=be ee 


2.1.2 PROGRESSIONS 
2.1.2.1. Arithmetic progression 


An arithmetic progression is a sequence of numbers such that the difference of any 
two consecutive numbers is constant. If the sequence is a1, G2, ...@n, where 
Aj41 — A= d, then Qk =a, + (k ca 1)d and 


ay tages +a = 5 (201 + (n-1)2). (2.1.1) 


In particular, the arithmetic progression 1,2,..., has the sum n(n + 1)/2. 


2.1.2.2 Geometric progression 

A geometric progression is a sequence of numbers such that the ratio of any two 
consecutive numbers is constant. If the sequence is a1, a2,...@n, where 

ai41/a; =r, then a, = ayr*—' and 





1—r” 
ay r#él 
a, +agt+---+an= l-r (2.1.2) 
nay, r= i; 


If |r| < 1, then the infinite geometric series aj(1+r+r? +r? +---) converges to 
nn For example, 1 + 4 + + + z +.-+-=2 (since a; = landr = 4). 





L= 
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2.1.2.3 Means 


b 
1. The arithmetic mean of a and b is given by ee More generally, the arith- 
metic mean of a1, a2,...,@p is given by (a1 + a2 +--+ +a,)/n. 
2. The geometric mean of a and b is given by Vab. More generally, the geometric 
mean of a1, @2,...,@n iS given by %/a1a2...Gn. 
1 2ab 


3. The harmonic mean of a and b is given by ——~——~ = : 
a(a+%) a+b 





If A, G, and H represent the arithmetic, geometric, and harmonic means 


1. of two positive values, then AH = G?. 
2. of any number of positive values, then A > G > H. 


2.1.2.4 Algebraic equations 


A polynomial equation in one variable has the form f(x) = 0 where f(2) is a 
polynomial of degree n 


f(z) = ay" + dnoie”™ | +--+ a0 + ao. (2.1.3) 

anda, # 0. 
A complex number z is a root of the polynomial f(a) if f(z) = 0. A complex 
number z is a root of multiplicity k if f(z) = f'(z) = f(z) =--- = f®-Y(z) =0, 








but f)(z) 4 0. A root of multiplicity 1 is called a simple root. A root of multiplicity 
2 is called a double root, and a root of multiplicity 3 is called a triple root. 


2.1.2.5 Roots of polynomials 


1. Fundamental theorem of algebra 


A polynomial equation of degree n has exactly n complex roots, where a dou- 
ble root is counted twice, a triple root three times, and so on. If the n roots of 
the polynomial f(x) are 21, 22, ..., Zn (where a double root is listed twice, a 
triple root three times, and so on), then the polynomial can be written as 


f(x) = an(a — 21)(a@ — 22)... (4 — Zn). (2.1.4) 


2. If the coefficients of the polynomial, {ao, a1,...,@n}, are real numbers, then 
the polynomial will always have an even number of complex roots occurring 
in pairs. That is, if z is a complex root, then so is Z. If the polynomial has an 
odd degree and the coefficients are real, then it must have at least one real root. 


3. Equations for roots of 2", 3", and 4" order equations are on pages 73— 74. 


4. The coefficients of a polynomial may be expressed as symmetric functions of 
the roots. For example, the elementary symmetric functions {s;}, and their 
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values for a polynomial of degree n (known as Vieta’s formulas), are: 


aAn-1 
s=atatetma—, 
an 
An-2 
82 = 2122 + 2123 + 29% Fe = S Biz = —, 
A fe an 
i>j (2.1.5) 
ao 


Sn = 212223...2n = (-1)"—. 
An 


where s;, is the sum of (7 *) products, each product combining & factors of roots 
without repetition. 


. The discriminant of a polynomial is | [;.. (21 — z;)*. (Note that the ordering of 


the roots is irrelevant.) The discriminant can always be written as a polynomial 
combination of ao, @1, ..., Qn, divided by ay. 


(a) For the quadratic ae ax? + ba +c = 0 the discriminant is os 
(b) For the cubic equation ax? + bx? + ca + d = 0 the discriminant is 


b?c? — 4b°d — 4ac? + 18abcd — 27a?d? 
—_—. —  —. 
a 


. The number of roots of a polynomial in modular arithmetic is difficult to pre- 


dict. For example 
(a) y4+y+1=O0has one root modulo 51: y = 37 
(b) y+ + y +2 =O has no root modulo 51 
(c) yt +y+3 =O has six roots modulo 51: y = {15, 27, 30, 32, 44, 47} 








2.1.2.6 Algebraic identities 





(a+ b)? = a? + 2ab + b?. 
(a+b)? = a° + 3a7b + 3ab? + O°. 
(a + b)* = a* + 4a%d + 6a7b? + 4ab3 + b+. 


(atb)" = mae ) ak +b)"-* where e = Aor 


=0 
a? +b? = (a+ bi)(a — bi). 
a* + bt = (a? + V2ab + b?) (a? — V2ab + 6°). 
a”? — b? = (a—b)(a +b). 
a? — B® = (a— b)(a? + ab +B”). 
a” — b” = (a—b)(a"* +a" 7b4+--- + ab”? + b"-4). 
+b+c¢)? =a? +b? +c? + 2ab 4+ 2ac+t 2be. 









































bFb+c)P =a2 +b? +03 +3(a7b+ ab? + a2ct ac? + b?c + bc”) + Gabe. 
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2.1.3 PARTIAL FRACTIONS 


The technique of partial fractions allows a quotient of two polynomials to be written 
as a sum of simpler terms. 

Let f(x) and g(a) be polynomials and let the fraction be f oe If the degree 
of f(x) is greater than the degree of g(a) then divide f(x) by g(x) to produce a 
quotient g(a) and a remainder r(2:), where the degree of (x) is less than the degree 


of g(x). That is, f a = q(x)+ — . Therefore, assume that the fraction has the form 
r(x) 


aay? where the degree of the numerator is less than the degree of the denominator. 


r(x) 
g(a) 














The techniques used to find the partial fraction decomposition of depend on the 


factorization of g(). 


2.1.3.1 Single linear factor 

Suppose that g(x) = (x — a)h(a), where h(a) 4 0. Then 
riz) A s(x) 
g(a) 2—a h(a)’ 








(2.1.6) 


where s(x) can be computed and the number A is given by r(a)/h(a). For example 
(here r(x) = 22, g(x) = 2? —1=(x—-1)(2 +1), h(x) =2+4+1, anda=1): 
2x il 1 
= 4 (2.1.7) 


w—-1 2-1 241 














2.1.3.2 Repeated linear factor 
Suppose that g(a) = (x — a)*h(a), where h(a) 4 0. Then 




















r(z) Ad A2 o Ax s(x) 
ge) ea" @=ap Ga aay 
for a computable s(x) where 
_ r(a) _ a (r(2) 
Ak = Fay’ Bet (ia) 7, 
2 (2.1.9) 
Ao at 4 (7) ie Sf 
2 2! da? \A(z)/|,_.’ I~ it ded \h(x)/ |, 








2.1.3.3 Single quadratic factor 
Suppose that g(x) = (x? + br + c)h(x), where b? — 4c < 0 (so that x? + br +c 
does not factor into real linear factors) and h(a) is relatively prime to x? + br + ¢ 
(that is h(a) and x? + ba +c have no factors in common). Then 
rs) Aris s(x) 
g(x) a2+bat+ce h(x) 














(2.1.10) 


2.2. POLYNOMIALS 73 


In order to determine A and B, multiply the equation by g(a) so that there are no 
denominators remaining, and substitute any two values for x, yielding two equations 
for A and B. 

When A and B are both real, if after multiplying the equation by g(x) a root of 
x? + bx + cis substituted for x, then the values of A and B can be inferred from this 
single complex equation by equating real and imaginary parts. (Since x? + br +c 
divides g(a), there are no zeros in the denominator.) This technique can also be used 
for repeated quadratic factors (below). 


2.1.3.4 Repeated quadratic factor 


Suppose that g(x) = (a? + br + c)¥h(x), where b? — 4c < 0 (so that 2? + br + ¢ 
does not factor into real linear factors) and h(x) is relatively prime to x? + bx +c. 
Then 


r(a) Ayx + By, Aor + Bo Agr Bg 


g(x) a%@+ba+e (a%+ba4+c)? (42+ ba +c) 
Aya + By s(x) 
(a2 +ba+c)k h(a)’ 





fees Ht 


In order to determine A; and B;, multiply the equation by g() so that there are no 
denominators remaining, and substitute any 2k values for x, yielding 2k equations 
for A; and B;. 





2.2 POLYNOMIALS 


All polynomials of degree 2, 3, or 4 are solvable by radicals. That is, their roots can 
be written in terms of algebraic operations (+, —, x, and +) and root-taking ( a ). 
While some higher degree polynomials can be solved by radicals (e.g., z'° = 1 can 
be solved), the general polynomial of degree 5 or higher cannot be solved by radicals. 


2.2.1 QUADRATIC EQUATION 


The solution of the quadratic equation ax? + bx + c = 0, where a ¥ 0, is given by 


—b+ Vb? — 4ac 
2a : 





a= (2.2.1) 
The discriminant of this equation is A = (b? — 4ac)/a?. If a, b, and c are all real 
and 


e A < 0, then the two roots are complex numbers which are conjugate. 
e A > 0, then the two roots are unequal real numbers. 
e A = 0, then the two roots are equal. 
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2.2.2 CUBIC POLYNOMIALS 


Given the cubic equation Ax? + Bx? + Cx + D = 0, divide the coefficients by A 
so the coefficient of the cubic term is one: 


x? + be? +cer+d=0 2%) 


To find the roots {x1, x2, 73} of this cubic define the following: 


F= - ae /27 @23) 
F? ES 
G= Tl 


If the coefficients {b, c, d} are real, then Equation (2.2.2) will have either 3 real roots 
or | real root and 2 imaginary roots. The next steps presume that {b, c, d} are real, 
this allows computations only involving real numbers. If {b, c,d} are not real then 
either of the following methods results in the same 3 roots. 


1. If G < 0, then there will be 3 real roots. Continue with 


(a) H = \/—E3/27 (f) ee ee 

(b) l= VH 3 : 
(c) J = cos"! (—F/2H) (g) = -I(K+1L)-—-— 
(d) K =cos(J/3) 3 
(e) L = V3sin (J/3) (h) #3 = -I(K—L)—3 


2. If G > 0, then there will be | real root and 2 complex roots. Continue with 


b 
(a) M= j= +Vv@ (c) tie 








(@) op = -MEN 8, {MNS 
M+N_ 0b M Ny 
@ =e Gos 


2.2.3 QUARTIC POLYNOMIALS 


Given the quartic equation b4x* + b3x? + box? +b, 2+ bo = 0, divide the coefficients 
by b, so the coefficient of the quartic term is one: 


ep agz° + agx” + a,2 + a9 = 0 (2.2.4) 


To find the roots {21, #2, 73, 74} of this quartic do the following: 
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1. Define the resolvant cubic to be z° + bz? + cz + d = 0 where 
b=—a2, c=aja3—4a9, d= 4a2a9 — at — azao 


2. Use Section 2.2.2 to find the solutions {21, 22,23}. If the coefficients 
{ag, 2,1, 49} are real, then there will be at least one real root z, which we 
select. If there are no real roots, then select any root z. 


2 3a2 
3. R=\B-atz 4. $= 2 — RB’ — 2a 








2/ z2 — dao ifR= 

5. T= 4azaz — 8a, — a3 

See es f 

IR ifR #0 

1 1 

6. os ae ba ght5 S+T 
1 1 1 

Ts 73,4 = ~ 703 1 5 SS S-T 


2.2.4 RESULTANTS 


Let f(z) = ant” +an_iz"™ 1+---+a9 and g(x) = bya™ +bm_iz™ 14+--++0o, 
where a, # 0 and b,, # 0. The resultant of f and g is the determinant of the 
(m+n) x (m+n) matrix 


Qn An—1 : ao 0 0 
0 Gx An—1 ay ao 0 
0 sac 0 An Qn-1 .-. Gy ao 
COG: dre teehee Sarees od A ahaa oly ateantdela Bed ailaieedes (2.2.5) 
0 0 bm, by bo 
0 by Orm—i bo O ... O 
bm Om-1 oe bo 0 “en ean 0) 


The resultant of f and g is 0 if and only if f and g have a common root. 


EXAMPLES 
1. For f(a) = 2? + 22 +3 and g(x;a) = 40° + 5a? + 6a + (7 + a), the resultant is 





Lee 0 
O12 8 0 
dett}0 0 1 2 3 | =(16+a)? 
045 6 Tta 
4 5 6 7T+a 0 
Note that g(a;—16) = (4a — 3)(x? + 2a + 3) = (4x — 3) f(z). 


2. The resultant of az + b and cx + d is da — be. 
3. The resultant of (a + a)° and (a +b)? is (b— a)”. 
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2.2.5 POLYNOMIAL NORMS 


The polynomial P(x) = x a,x! has the norms: 
j=0 


Pil, = " p ig) a P\L= : 
|P\]a = ' |P (e ee | b= Des 
1/2 


20 : d@ n 
Pie=(f Pen? 2) Pk = (Sola? 
j=l 


I|Plloo = eee) 
2|=1 


[Pao = max [ay 


For the double bar norms, P is considered as a function on the unit circle; for the 
single bar norms, P is identified with its coefficients. These norms are comparable: 


|Ploo < ||Plla $|Ple =l|Pll2 <llPlleo $1Pli<nlPloo. (2.2.6) 


2.2.6 OTHER POLYNOMIAL PROPERTIES 


1. Jensen’s inequality: For the polynomial P(a) = S- a;x), with ap 4 0 


j=0 
27 
yn ,, dO 
| log |P (e'”) | = > log |ao| O27) 
0 21 
2. Symmetric form: The polynomial P(x,...,0n) = x Ogi he Ks 
ja|=m 
where a = (a1,...,ay) can be written in the symmetric form 
N 
P(x, sey in) = »\. Ciy,..., im Vi, Vig +++ Li, (2.2.8) 
tyeesim=l 
with ¢, 4, = So This means that the x7; x2 term is written as 
Lyeeeytm m! OXj,---OLim 
4 (2122 + 2221), the term x;x3 becomes 3 (a1 2202 + £20122 + @2X2%1). 
3. The Mahler measure (a valuation) of the polynomial P(x) = a,x” + 


Gn—12"-1 +--+ +49 = Gn(x — 21)(x — 22)... (x — Zn) is given by 


M(P) = |an| [ [mati |z;|) = exp (f log |P (e?"“)| it) 


i=1 
This valuation satisfies the properties: 
(a) M(P) M(Q) = M(PQ) 
(b) M(P(x)) = M(P(—2)) = M(P(a*)) fork > 1 
(©) M(P(2)) = M(a" P(@™)) 
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2.2.7 CYCLOTOMIC POLYNOMIALS 


The d cyclotomic polynomial, ®a(x) is 
d 








@a(z)= J] (@-&) =2° +. (2.2.9) 
k=1,2,... 
(ke,d)—=1 
where the €, = e?7**/¢ are the primitive d'” roots of unity 
p-1 p 
: —1 
®, (x) > = — i if p is prime 
k=0 
x” —1=]] (2) (2.2.10) 
d|n 
er — |] _ Hajan Pale) Oa(x 
"l= Pot 
e+ 71 ~ Tan Bala) dala =| ata(@ 


d|m 


where n = 2'—!m and m is odd. 


























nm cyclotomic polynomial of degree n 

1 -l+2 

2 i1+¢2 

3 l+e4+e2=251 

4 1+? 

5 l+at+a?+23 gt = Zt 

6 1-2+2? : 
7 ltata?+23 at +25 426 = £1 
8 1+2* 

9 l+a3+2a° 

10 1-#+2?-2°+4+24 

HW itete?te2 tata 408407 428 4094 g!0 = 21 


x 





12 1—2?+2+ 


Some relations: 
1. If pis an odd prime: 








er Ap 1 2 il 
@) &(x) = (©) ®9(2) = Seay 
_ oP-1e-1 (d) x? —1= ®,(z)®,(z) 
0) Gent) = (e) 2? — 1 = &)(2)b9(z) p(x) Bop(z) 


2. If pis a prime and 


(a) p does not divide n then ©,,,(%) = ®,,(x?)/®, (x) 
(b) p divides n then ©,,,(x) = ®,, (x?) 
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2.3 VECTOR ALGEBRA 


2.3.1 NOTATION FOR VECTORS AND SCALARS 


A vector is an ordered n-tuple of values. A vector is usually represented by a low- 
ercase, boldfaced letter, such as v. The individual components of a vector v are 
typically denoted by a lowercase letter along with a subscript identifying the relative 
position of the component in the vector, such as v = [v1, v2,..-., Un]. In this case, 
the vector is said to be n-dimensional. If the n individual components of the vector 
are real numbers, then v € R”. Similarly, if the n components of v are complex, 
then v € C”. 

Subscripts are often used to identify individual vectors within a set of vectors all 
belonging to the same type. For example, a set of n velocity vectors can be denoted 
by {v1,..., Vn}. In this case, a boldface type is used on the individual members of 
the set to signify these elements of the set are vectors and not vector components. 

Two vectors, v and u, are said to be equal if all their components are equal. The 
negative of a vector, written as —v, is one that acts in a direction opposite to v, but is 
of equal magnitude. 


2.3.2 PHYSICAL VECTORS 


Any quantity that is completely determined by its magnitude is called a scalar. For 
example, mass, density, and temperature are scalars. Any quantity that is completely 
determined by its magnitude and direction is called, in physics, a vector. We often 
use a three-dimensional vector to represent a physical vector. Examples of physical 
vectors include velocity, acceleration, and force. A physical vector is represented by 
a directed line segment, the length of which represents the magnitude of the vector. 
Two vectors are said to be parallel if they have exactly the same direction, i.e., the 
angle between the two vectors equals zero. 


2.3.3 FUNDAMENTAL DEFINITIONS 


1. A row vector is a vector whose components are aligned horizontally. A column 
vector has its components aligned vertically. The transpose operator, denoted 
by the superscript ', switches the orientation of a vector between horizontal 
and vertical. 


EXAMPLE 1 
v= [12,34 FS (oho OY =12,341. 
4 
row vector column vector row vector 


Vectors are traditionally written either with rounded braces or with square 
brackets. 
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2. Two vectors, v and u, are said to be orthogonal if viu = 0. (This is also 
written v - u = 0, where the “-” denotes an inner product; see page 80.) 

3. A set of vectors {v1,..., Vn} is said to be orthogonal if vj v; = 0 for alli 4 j. 

4. A set of orthogonal vectors {v1,..., Vin} is said to be orthonormal if, in addi- 
tion to possessing the property of orthogonality, the set possesses the property 
that viv; =1foralll <i<m. 


2.3.4 LAWS OF VECTOR ALGEBRA 


1. The vector sum of v and u, represented by v + u, results in another vector of 
the same dimension, and is calculated by simply adding corresponding vector 
components, e.g., if v,u € R”, then v + u = [vy + W1,..-,Un + Un). 

2. The vector subtraction of u from v, represented by v — u, is equivalent to the 
addition of v and —u. 

3. Ifr > 0 is a scalar, then the scalar multiplication rv (equal to wr) represents 
a scaling by a factor r of the vector v in the same direction as v. That is, the 
multiplicative scalar is distributed to each component of v. 

4. If0 <r < 1, then the scalar multiplication of r and v shrinks the length of v, 
multiplication by r = 1 leaves v unchanged, and, if r > 1, then rv stretches 
the length of v. When r < 0, scalar multiplication of r and v has the same 
effect on the magnitude (length) of v as when r > 0, but results in a vector 
oriented in the direction opposite to v. 


EXAMPLE | i A _ i - | “] | 


5. Ifr and s are scalars, and v, u, and w are vectors, the following rules of algebra 
are valid: 


v+u=u+yV, 


r+s)V=1V+sV=vrt+vs=vi(r+s), 
( ) ( ) (2.3.1) 
r(v+u)=rv+ru, 


v+(u+w) =(v+u)+w=v+u4w. 


2.3.5 VECTOR NORMS 


1. A norm is the vector analog to the measure of absolute value for real scalars. 
Norms provide a distance measure for a vector space. 

2. A vector norm applied to a vector v is denoted by a double bar notation ||v]|. 

3. A norm on a vector space equips it with a metric space structure. 

4. The properties of a vector norm are: 


(a) For any vector v 4 0, ||v|| > 0, 
(b) |lyvll =I71 |IvIl, and 
(c) ||v-+ ul] < |/v|| + |lul] (triangle inequality). 
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5. The most commonly used vector norms on R” or C” are: 


(a) The L' norm is defined as ||v||, = |vi| +--+ +|%n| = 34-4 luil- 
(b) The L? norm (Euclidean norm) is defined as 


n 1/2 
IIvl], = (orl? + fug|? +--+ + Jun|?)4/? = (>: “) » 32) 


i=l 


(c) The L° norm is defined as ||v||,, = max |v]. 
l<i<n 


6. When there is no subscript, the norm ||-|| is usually assumed to be the L? norm. 
7. A unit vector with respect to a particular norm ||-|| is a vector that satisfies the 
property that ||v|| = 1, and is sometimes denoted by Vv. 


EXAMPLE The vector x = [1 2 3] in different norms: 
xl], =6 — |[xl| =|[xll, = V14 3.74 ||x||, = 67/7 & 3.30 | |x||_, =3 


2.3.6 DOT, SCALAR, OR INNER PRODUCT 


1. The dot (or scalar or inner) product of two vectors of the same dimension, 
represented by v - u or v'u, has two common definitions, depending upon the 
context in which this product is encountered. 


(a) The dot or scalar product is defined by v-u = |ly|| |/ul| cos 0, 
where @ represents the angle between the vectors v and u. 
(b) The inner product of two vectors, u and v, is equivalently defined as 


n 
uly = > UzU; = ULV + +++ +UnUn. (2.3.3) 
i=l 


From the first definition, it is apparent that the inner product of two perpendic- 
ular, or orthogonal, vectors is zero, since the cosine of 90° is zero. 

2. The inner product of two parallel vectors (with u = rv) is given by v- u = 
r ||v\|° . For example, when r > 0, 


v-u = [[y{| |[ul| cosO = [Iv [ful] = [lvl Irvl] =r [lvl (2.3.4) 
3. The dot product is distributive, e.g., 
(v+u)-w=v-w+u-w. (2.3.5) 
4. For v,u, w € R” with n > 1, 
viu=viw - u=w. (2.3.6) 
However, it is valid to conclude that 
viu=v'w > v'(u— w) =0, (2.3.7) 


i.e., the vector v is orthogonal to the vector (u — w). 
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FIGURE 2.1 
Depiction of right-hand rule. 


V4 x V2 





2.3.7 VECTOR OR CROSS-PRODUCT 


1. The vector (or cross-) product) of two non-zero 3-dimensional vectors v and 
u is defined as 
vxu=n||y|| |lul/ sind, (2.3.8) 


where ni is the unit normal vector (i.e., vector perpendicular to both v and u) 
in the direction adhering to the right-hand rule (see Figure 2.1) and @ is the 
angle between v and u. 

2. If v and ware parallel, then v x u= 0. 

3. The quantity ||v|| ||ul| |sin @| represents the area of the parallelogram deter- 
mined by v and u. 

4. The following rules apply for vector products: 





(vv) x (au) = (ya)v x u, 
vxu=-—uxvV, 
vx (u+w)=vxu+vxw, 
(v+u)xXw=vxwt+uxw, 
(2.3.9) 
v x (u X w) = u(w- v) — w(v- 4), 
(v x u)- (wx z) = (v- w)(u- z) — (v-z)(u- w), 
(v x u) x (w x z) = [v- (ux z)]w— [v-: (ux w)]z 
= |v- (w x z)ju— [u- (w x z) 
5. The pairwise cross-products of the unit vectors i, j, and k, corresponding to 
the directions of v = vji+ v2j + vsk, are given by 


ixj=-@xi) =, 

Peto ed 

Z és ( ) : (2.3.10) 
kxi=—(ixk)=j, and 

ixi jxj kxk=0 
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6. Ifv= vi + vj + v3k and u = ui + uj + u3k, then 
i fe : ; ; 
vXu=Jv, v2 v3| = (vou3 — Ugus)i+ (v3u1 — U301)j + (ULU2 — W102 )k. 
Uy UQ U3 


@3411 
2.3.8. SCALAR AND VECTOR TRIPLE PRODUCTS 


1. The scalar triple product involving three 3-dimensional vectors v, u, and w, 
sometimes denoted by [vuw] (not to be confused with a matrix containing three 
columns Iv u w] ), 1s defined to be 
































raw] =v: (ux w) =v. | | U3 = U1 whit 1 U2 | 
We Ws Wi W3 WwW, We 
U2 U3 U1 3 1 U2 
=V\ tig Ws ow, w + U3 ip. dis 
V1 V2 U3 
=|U1 U2 U3 (2.3.12) 
Wi, W2 W3 
= [lvl] |lul| [wll cos ¢ sin 6, 





where @ is the angle between u and w, and ¢ is the angle between v and the 
normal to the plane defined by u and w. 

2. The absolute value of a triple scalar product calculates the volume of the par- 
allelepiped determined by the three vectors. The result is independent of the 
order in which the triple product is taken. 

. (v Xu) X (Ww x z) = [vwzju — [uwz|v = [vuz|w — [vuw])z 

4. Given three non-coplanar reference vectors u, v, and w, the reciprocal system 

is given by u*, v*, and w*, where 


io) 


wxv ux Ww vxu 
* * — * —=——. 2.3.13 
[vuw] 7 [vuw] ’ ™ [vuw] ( ) 


If the vectors v, u, and w are mutually perpendicular, then 


* 


l=v-v =u-w=w-w 








(2.3.14) 





and 0=v-u* =v-w =u-V’, etc. 





The system i, j. k is its own reciprocal. 

5. The vector triple product involving three 3-dimensional vectors v, u, and w, 
given by v x (u x w), results in a vector, perpendicular to v, lying in the plane 
of u and w, and is defined as 


v Xx (u xX w) = (v- w)u— (v- u)w, 


UL U2 U3 (2.3.15) 




















2.4. LINEAR AND MATRIX ALGEBRA 83 





2.4 LINEAR AND MATRIX ALGEBRA 


2.4.1 
1. 


ad 


4 


16. 
17. 


DEFINITIONS 


An m Xn matrix is a 2-dimensional array of numbers consisting of m rows and 
n columns. By convention, a matrix is denoted by a capital letter emphasized 
with italics, as in A, B, D, or boldface, A, B, D. Sometimes a matrix has a 
subscript denoting the dimensions of the matrix, e.g., A2.3. If Aisarealnxm 
matrix, then we write A € R”*'. Higher-dimensional matrices, although 
less frequently encountered, are accommodated in a similar fashion, e.g., a 
3-dimensional matrix Amn p, and so on. 

Amxn is called rectangular if m # n. 

Amxn is called square ifm = n. 

A particular component (or element) of a matrix is denoted by the lowercase 
letter corresponding to the matrix name, along with two subscripts for the row 2 
and column 7 location of the component in the matrix, e.g., 


Amxn has components a;;; 


Bray has components );;. 


For example, a23 is the component in the second row and third column of 
matrix A. 


Any component a;; with 2 = 7 is called a diagonal component. 

The diagonal alignment of components in a matrix extending from the upper 
left to the lower right is called the principal or main diagonal. 

Any component a,;; with i # 7 is called an off-diagonal component. 

Two matrices A and B are said to be equal if they have the same number of 
rows (m) and columns (n), and a;; = bj; forall 1 <i <m,1<j <n. 

An m x 1 dimensional matrix is called a column vector. Similarly, a 1 x n 
dimensional matrix is called a row vector. 

A vector with all components equal to zero is called a null vector and is usually 
denoted by 0. 





. A zero, or null matrix is one whose elements are all zero (notation is “‘0’’). 
. Acolumn vector with all components equal to one is often denoted by e. The 


analogous row vector is denoted by e’. 


. The standard basis consists of the vectors {e;,€2,...,€,} where e; is ann x 1 


vector of all zeros, except for the qh component, which is one. 
The scalar x'x = 5>""_, x? is the sum of squares of all components of the 
vector X. 


. The weighted sum of squares is defined by x’ D,,x = >; wix?, when x has 


n components and the diagonal matrix D,, is of dimension (n x 1). 

If Q is a square matrix, then x’ Qx is called a quadratic form (see page 101). 
Ann Xx n matrix A is called non-singular, or invertible, or regular, if there 
exists ann X n matrix B such that AB = BA = I. The unique matrix B 
satisfying this condition is called the inverse of A, and is denoted by A~!. 
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19. 


20. 


21. 


22. 
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The scalar x'y = )>""_, xjy;, the inner product of x and y, is the sum of 
products of the components of x by those of y. 

The weighted sum of products is x’ Dy,y = ppm w;,Xx;yi, when x and y have 
n components, and the diagonal matrix D,, is (n x 1). 

The map x, y > x! Qy is called a bilinear form, where Q is a matrix of appro- 
priate dimension. 

The transpose of an m x n matrix A, denoted by A?, is an n x m matrix with 
rows and columns interchanged, so that the (7, 7) component of A is the (j, 7) 
component of A™, and (A™),; = (A)ij = aij. 

The Hermitian conjugate of a matrix A, denoted by A", is obtained by trans- 
posing A and replacing each element by its complex conjugate. Hence, if 
Akl = Ut + 2g, then (AF) p7 = Uk — 1Uiz, With 1 = Jl. 

If Q is a square matrix, then the map x > x"Qx is called a Hermitian form. 


2.4.2 TYPES OF MATRICES 


1. 


A square matrix with all components not on the principal diagonal equal to 
zero is called a diagonal matrix, typically denoted by the letter D with a sub- 
script indicating the typical element in the principal diagonal. For example: 


ai1 0 0 Mi 0 0 
Dy = 0 a2 0 5 Dy = 0 A22 0 
0 0 433 0 0 A33 


A matrix whose components are arranged in m rows and a single column is 
called a column matrix, or column vector, and is typically denoted using bold- 
face, lowercase letters, e.g., a and b. 

A matrix whose components are arranged in n columns and a single row is 
called a row matrix, or row vector, and is typically denoted as a transposed 
column vector, e.g., a’ andb!. 

The identity matrix, denoted by I, is the diagonal matrix with a;; = 1 for all 
i= j,and aj; = 0 fori # j. The n x n identity matrix is denoted J;,. 

The elementary matrix, E;;, is defined differently in different contexts: 


(a) Elementary matrices have the form E;; = ee). Hence, the matrix 
A = (a;;) can be written as A = )°,; LF aij Ei;. 

(b) In Gaussian elimination, the matrix that subtracts a multiple / of row 7 
from row 7 is called £;;, with 1’s on the diagonal and the number —/ in 
row 7 column j. For example: 


1 00 0 
0 10 0 
P= le ao 
0001 


(c) Elementary matrices are also written as E = I — auv', where J is the 
identity matrix, a is a scalar, and u and v are vectors of the same dimen- 
sion. In this context, the elementary matrix is referred to as a rank one 
modification of an identity matrix. 


17. 


18. 


19. 


20. 
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A matrix with all components above the principal diagonal equal to zero is 
called a lower triangular matrix. For example: 


ay 0 0 
A= |aq1 da O is lower triangular. 
431 432 433 


A matrix with all components below the principal diagonal equal to zero is 
called an upper triangular matrix. (The transpose of a lower triangular matrix 
is an upper triangular matrix.) 

A matrix A = (a;,;) has lower bandwidth p if aj; = 0 whenever i > j + p and 
upper bandwidth q if a;; = 0 whenever 7 > 7 + q. When they are equal, they 
are the bandwidth of A. A diagonal matrix has bandwidth 0. A tridiagonal 
matrix has bandwidth 1. An upper (resp. lower) triangular matrix has upper 
(resp. lower) bandwidth of n — 1 (resp. m — 1). 

An m xX n matrix A with orthonormal columns has the property ATA = I. 

A square matrix is called symmetric if A = Al. 


. A square matrix is called skew symmetric if AT = —A. 
. A square matrix is called idempotent if AA = A? = A. 
. A square matrix is called Hermitian if A = A". A square matrix A is called 


skew-Hermitian if A" = —A. All real symmetric matrices are Hermitian. 
A square matrix is called unitary if A.A = J. A real unitary matrix is orthog- 
onal. All eigenvalues of a unitary matrix have an absolute value of one. 


. A square matrix is called a permutation matrix if its columns are a permutation 


of the columns of J. A permutation matrix is orthogonal. 


. A square matrix is called a projection matrix if it is both Hermitian and idem- 


potent: AY = A? = A. 

A square matrix is called normal if AXA = AA. The following matrices 
are normal: diagonal, Hermitian, unitary, skew-Hermitian. Pseudospectra are 
useful for understanding non-normal operators, see page 105. 

A square matrix is called nilpotent to index k if AY = 0 but A*—! # 0. The 
eigenvalues of a nilpotent matrix are all zero. 

A square matrix, whose elements are constant along each diagonal, is called 
a Toeplitz matrix. Toeplitz matrices are symmetric about a diagonal extend- 
ing from the upper right-hand corner element to the lower left-hand corner 
element. This type of symmetry is called persymmetry. Example Toeplitz 
matrices: 


ade 4 0 1 
A=1!baqa€d and Mz=|-11 4 0 
c ba 3 —l1l 4 


A square matrix @ with orthonormal columns is said to be orthogonal. It 
follows directly that the rows of Q must also be orthonormal, so that QQ™ = 
Q™Q =I, or Q? = Q7!. The determinant of an orthogonal matrix is +1. 

A rotation matrix is an orthogonal matrix whose determinant is equal to +1. 
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A Vandermonde matrix is a square matrix V € R(&"+)*(+) in which each 


column contains unit increasing powers of a single matrix value: 


a ‘li a's 1 
Uy U2 ***) U(m+1) 
2 2 2 
Va] U2 7" Un+iy} . (2.4.1) 
ut Us a aaa Vind) 





A square matrix U is said to be in upper Hessenberg form if u;; = 0 whenever 
i > j+1. An upper Hessenberg matrix is essentially an upper triangular matrix 
with an extra non-zero element immediately below the main diagonal entry in 
each column of U. For example, 


U1l1 U12 U13° ~U14 

ts boi U22 23° U24 
0 $32 u33 U34 

0 0 b43 U44 


is upper Hessenberg. 


A circulant matrix is ann x n matrix of the form 


Co Cy C2 **' Cn—-2 Cn-1 
Cn—-1 CO Cy c** Cn—-3  Cn—2 
pa eae Che C a nr ee oa 
C= n—2 n—-1 0 n—A n—3 ‘ (2.4.2) 
Cy C2 C3 ttt) Cn-1 Co 


where the components c;; are such that (j — 7) = k mod n have the same 
value cy. These components comprise the k" stripe of C. 


aii 412 413 . . 
then its fixed axis of 


If a rotation is defined by the matrix A = EE a22 a2 
431 432 43 

rotation is given by v = i(a23 — ag2) + j(a31 — a13) + K(a12 — aa1). 

A Givens rotation is defined as a rank two correction to the identity matrix 


given by 


3 
3 


1 0 0 0 
0 Cc Ss O] 2 

G(i, k, 0) = : (2.43) 
0 —s Cc Ol k = 


20. 


21s 


28. 


2.4. 
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where c = cos@ and s = sin@ for some angle @. Pre-multiplication by 
G(i, k, 0)" induces a counterclockwise rotation of 6 radians in the (i, k) plane. 
For x € R” and y = G(i, k, 9)'x, the components of y are given by 


CX; — S€&_p, forg=7t 
Yj = 4 sui t+cr,, forj =k (2.4.4) 
Lj, for j #i,k. 


If the sum of the components of each column of a matrix A € R"*” equals 
one, then A is called a Markov matrix. 

A Householder transformation, or Householder reflection, is an n * nm matrix 
H of the form H = J — (2uu")/(u'u), where the Householder vector u € R” 
is non-zero. 

A principal sub-matrix of a symmetric matrix A is formed by deleting rows 
and columns of A simultaneously, e.g., row 1 and column 1; row 9 and column 
9, etc. 


3 HADAMARD MATRICES 





A Hadamard matrix of order n is an n X n matrix H with entries +1 such that 
HH™ = nlI,. In order for a Hadamard matrix to exist, n must be 1, 2, or a mul- 
tiple of 4. It is conjectured that this condition is also sufficient. If H, and H2 are 
Hadamard matrices, then so is the Kronecker product H; ® A. 


TOW 


Without loss of generality, a Hadamard matrix can be assumed to have a first 








and column consisting of all +1s. 
For the constructs below, we use either ““—” to denote —1 or MI to denote +1. 
i= 2 n=4 n= 8 
[ lt 2 FT 2 kf 2. hl 
1 1 1 1 
1 2 & 2 12+. 1 1 = = 
1 1 1 - 1 = 1 - -—- 1 1 - —- JI 
— 11 - - 11121 -- - - 
1 - - JI 1 1 1 1 
11 - -~- ~ —~ 1 1 
1 - 1 - 1 1 = 
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2.4.4 MATRIX ADDITION AND MULTIPLICATION 


1. Two matrices A and B can be added (subtracted) if they are of the same di- 
mension. The result is a matrix of the same dimension. 


EXAMPLE 


2-2 241), fit <9 3). fie 0 3 
Axa + Baxs = [1 0 3 +s 1 =a 1 fale 


2. Multiplication of a matrix or a vector by a scalar is achieved by multiplying 
each component by that scalar. If B = aA, then bj; = aaj;. 

3. The matrix multiplication AB is only defined if the number of columns of A 
is equal to the number of rows of B. 

4. The multiplication of two matrices Ay,xn and By xq results in a matrix Cm xq 
whose components are defined as 


cig = > aandig (2.4.5) 
k=1 


for? = 1,2,...,mandj =1,2,...,q. Each c;; is the result of the inner (dot) 
product of the i" row of A with the j" column of B. 


j" column of B 


" row of A ij element of C 


tl 
7 


This rule applies similarly for matrix multiplication involving more than two 
matrices. If ABCD = E then 


Big = YY Sand aicincdeny- (2.4.6) 
k l 


m 


The second subscript for each matrix component must coincide with the first 
subscript of the next one. 


EXAMPLE 


5 _ = 
2 <1 | > - > _ Be =5 il 
4 1 44/7 7S 46 18 31 


5. Multiplication of rows times matrices and matrices times columns can be il- 
lustrated as follows: 


=|) Ml l-[ 0 


fon 


10. 


11. 


12. 


13. 
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. In general, matrix multiplication is not commutative: AB 4 BA. 
. Matrix multiplication is associative: A(BC) = (AB)C. 
. The distributive law of multiplication and addition holds: C(A+ B) =CA+ 


CB and (A+ B)C = AC + BC. 


. Both the transpose operator and the Hermitian operator reverse the order of 


matrix multiplication: (ABC)' = C™B'A! and (ABC)# = CHBH AH, 
Strassen algorithm: The matrix product 


G11 442) |b. by2 — fC11 C12 
a21 G22} |b21  be2 C21 «C22 


can be computed in the following way: 











my = (a12 _ a22)(b21 +r bo2), Cu = M1 + M2 — M4 + Meo, 
m2 = (a11 +r a22)(b11 ae bo2), C12 = ™4 + ™M5, 

m3 = (@11 — a21)(b11 + b12), C21 = Me +™Mz7, and 

ma = (11 + 12)b22, c22 = Mz — M3 + M5 — M7. 
ms = a11(bi2 — bez), 


= a2(bo1 _ bit), 


M7 = (a1 + ao2)bi1, 


z 
| 


This computation uses 7 multiplications and 18 additions and subtractions. 
Using this formula recursively allows multiplication of two n x n matrices 
using O(n!°827) = O(n?-°°7---) scalar multiplications. Improved algorithms 
can achieve O(n?:3"6---). 

The order in which matrices are grouped for multiplication changes the 
number of scalar multiplications required. The number of scalar multi- 
plications needed to multiply matrix Xq.», by matrix Y;x. is abc, with- 
out using clever algorithms such as Strassen’s. Consider the product P = 
Ajox100B100x5Csx50- The grouping P = ((AB)C) requires (10x 100 5)+ 
(10 x 5 x 50) = 7,500 scalar multiplications. The grouping P = (A(BC)) 
requires (10 x 100 x 50) + (100 x 5 x 50) = 75,000 scalar multiplications. 
Pre-multiplication by a diagonal matrix scales the rows 


dj, O -:- O a1 *** Q1m dyjayy +++) dy1@1m 
0 dg 0 a21 +++ Gam dg2a21 +++ ~~ d22Q2m 
0 0 dnn Ani *** QAnm dnnGni pecs dnndnm 


Post-multiplication by a diagonal matrix scales the columns 


a1 0+ Gim| |di O --- 0 diay, +++) dmm@im 
a21 +++ Gam 0 dz 0 dya21_ ++: dmmG2m 


Qn st nm 0 0 dim dani is dmm@nm 
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2.4.5 DETERMINANTS 


1. The determinant of a square matrix A, denoted by |A| or det(A) or det A, is 
a scalar function of A defined as 


441 G12 "** Gin 441 G12 ""* Gin 
G21 422 ""* Gan a21 422 ‘"* Gan 
An aAn2 ees ann an aAn2 nes ann (2.4.7) 


_ So sgn(o)a1,9(1) @2,0(2) *** &n,o(n) 


5 
= pe (—1)° ari, Gain +++ Gni,, 
where the sum is taken either 


(a) over all permutations o of {1,2,...,} and the signum function, sgn(c), 
is (—1) raised to the power of the number of successive transpositions 
required to change the permutation o to the identity permutation; or 


(b) over all permutations i; 4 ig #4 --- # in, and 6 denotes the number of 
transpositions necessary to bring the sequence (71, 72,...,%,) back into 
the natural order (1,2,..., 7). 
2. Fora2 x 2 matrix, | G3} 33 | = @11@22 — @12021. 





For a3 x 3 matrix, 


411 412 413 
21 422 423) = A11422033 + 412023431 + A13421432 


a31 432 433 248) 


— 413422431 — 411423432 — 412421433. 


3. The determinant of the identity matrix is one. 

Note that |.A||B| = |AB| and |A| = |.A"|. 

5. Interchanging two rows (or columns) of a matrix changes the sign of its 
determinant. 

6. A determinant does not change its value if a linear combination of other rows 
(or columns) is added to or subtracted from any given row (or column). 

7. Multiplying an entire row (or column) of A by a scalar y causes the determi- 
nant to be multiplied by the same scalar ¥. 

8. For ann x n matrix A, |yA| = y"|Al]. 

9. If det (A) = 0, then A is singular; if det (A) 4 0, then A is non-singular or 
invertible. 

10. det (A~') = 1/ det (A). 

11. When the edges of a parallelepiped P are defined by the rows (or columns) 
of A, the absolute value of the determinant of A measures the volume of P. 
Thus, if any row (or column) of A is dependent upon another row (or column) 
of A, the determinant of A equals zero. 


- 





12. 


13. 


14. 


15. 


16. 
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The cofactor of a square matrix A, cof;; (A), is the determinant of a sub-matrix 
obtained by striking the i'* row and the j"" column of A and choosing a positive 
(negative) sign if (2 + 7) is even (odd). 

EXAMPLE 


2 =A 
cofe3 6 





7 2 4 
1 5{| =(-1)?*° is i = —(24+8)=—-10. (2.4.9) 
=9 1 3 


Let a;; denote the components of A and a‘! those of A~'. Then, 


a’? = cof;;(A)/|Al. (2.4.10) 

Partitioning of determinants: Let A = [8 &]. Assuming all inverses exist, 
then 

|A| =|E| |(B - CE7'D)| =|B| |(B- DB-'c)|. (2.4.11) 


Laplace development: The determinant of A is a combination of row 7 (col- 
umn 7) and the cofactors of row 2 (column 7), i.e., 


| A| = aj cof; (A) + ajgc0fj2(A) f-eeet QinCOfin(A), 


2.4.12 
=> aj COf; j (A) + a2;C0f2; (A) +.--. + AnjCOf,; (A), ( ) 


for any row 7 or any column 7. 

Omitting the signum function in Equation (2.4.7) yields the definition of per- 
manent of A, given by per A = 7), 41,5(1) + Gn,o(n)- Properties of the per- 
manent include: 


(a) If Ais an m x n matrix and B is ann xX m matrix, then 
|per(AB)|* < per(AA®) per(B"B). (2.4.13) 


(b) If P and Q are permutation matrices, then per PAQ = per A. 
(c) If D and G are diagonal matrices, then per DAG = per D per A per G. 
(d) Computation of the permanent is #P-complete. 


2.4.66 TRACES 


NN & YW 


. The trace of an n x n matrix A, usually denoted as tr(A), is defined as the 


sum of the n diagonal components of A. 


. The trace of ann x n matrix A equals the sum of the n eigenvalues of A, i.e., 


tr A = ay, +492 +°++ +Gnn = AY tAQ+H-++° +An. 


. The trace of al x 1 matrix, a scalar, is itself. 

. If Ae R™** and B € R**™, then tr(AB) = tr(BA). 

. tr(A+ 7B) = tr(A) + ytr(B), where ¥ is a scalar. 

. tr(AB) = (Vec A‘)! Vec B (see Section 2.4.18 for the Vec operation) 
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2.4.7 MATRIX NORMS 


1. 


Nn 


. If A is symmetric, then ||.A||, = max; |A; 
. The following properties hold: 


The mapping g : R”*" = R is a matrix norm if g satisfies the same three 
properties as a vector norm: 


(a) g(A) => 0 for all A and g(A) = 0 if and only if A = 0, so that (in norm 
notation) ||.A|| > 0 for all non-zero A. 

(b) For two matrices A,B € R™*", g(A + B) < g(A) + g(B), so that 
|A+ Bll < |All + ||BI. 

(c) g(rA) = |r|g(A), where r € R, so that ||yA]| = |y| || All]. 


. The L? norm of a matrix A is the number defined by 


|| Ax|| 
|All, =sup 7 * 


— (2.4.14) 
x40 |IXll, 


where ||-|,, represents one of the L” (vector) norms with p = 1, 2, or oo. 


(a) The L* norm of Am xn is defined as || A||, = maxi<j<n D>, |@iy|- 

(b) The L? norm of A is the square root of the largest eigenvalue of A’ A, 
(i.e., || Alls = Xmax(A™A)), which is the same as the largest singular 
value of A, ||Al|, = 01 (A). 

(c) The L°° norm is defined as ||.A||,, = maxi<i<m Ler |aiy|. 

(d) The unit circle, ||x|| = 1 in different norms (p = 2/3, 1, 2, 00): 


ee ee ia 
| | Se. | 



































. The Frobenius or Hilbert—Schmidt norm of a matrix A is the number 


|All» = 1/021 51 laiy|? which satisfies || Al] = tr(A™ A). 


Since R™*” is isomorphic to R’”, the Frobenius norm can be interpreted 
as the L? norm of an nm x 1 column vector in which each column of A is 
appended to the next in succession. 





, where {A,} are A’s eigenvalues. 


1 

a All, < llAlle < VellAll, 

max |ai;| < ||All> < Vmn max |ajj|, and (2.4.15) 
1) zy) 


1 
— |All, < |All, < vm , 
Tn) loo S$ llAlle S$ VmIAllo 


. The matrix p norms satisfy the additional property of consistency, defined as 


|ABl, < All, II. 


. The Frobenius norm is compatible with the vector 2 norm, that is 


|| Ax|| » < ||All- ||x||.- Additionally, the Frobenius norm satisfies the condi- 
tion || Ally < ||Allz < V7|lAlle- 
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2.4.8 SINGULARITY, RANK, AND INVERSES 


i. 


nAbBwWbd 


10. 


11. 


12. 
13. 
14. 
15. 


Ann Xx n matrix A is called singular if there exists a vector x # 0 such that 
Ax = 0 or A'x = 0. (Note that x = 0 means all components of x are zero). If 
a matrix is not singular, it is non-singular. 


. (AB)~! = B~!A™+, provided all inverses exist. 
(AT = (ATH, 

- (YA)? = (1/1) A. 

. If Dy is a diagonal matrix, then D7,’ = Dy jy: 


a 
EXAMPLE 1fD,=|"" © |ihenpdz?=Di,=|" 2° |, 
0 W22 0 oan 


W22 


. Partitioning: Let A = [8 ©]. Assuming that all inverses exist, then 


A-1 =[*£ }], where 
X=(B-CE™'D)", U=(E-DB'cy' 
Y =-B'CU, Z=—-—E™"DxX. 


. The inverse of a 2 x 2 matrix is as follows (defined when ad ¥ bc): 





a b) 1 d — 
c d ~ ad—be|—c a 


. If A and B are compatible square matrices and are both invertible, then 





(A4+ B)1=B(A14B9)¢ At=41 (414 B77)" BO. 


. If A and B are compatible square matrices and B is of rank one, then 


(A+B) +=At- yA Bs 
(64 


where a is the trace of (BA~'). 





EXAMPLE IfC = alee with c 4 1,—2 then C = A+ B where A = 
(c-yr=["o ars = 6 | and B= [iii], Since a = trace (BA~') = 4 
ie he ae ma [ sail (ce — 1)( Se [tt =] 
Let B = (b;;) have inverse B~* = (b'7), Let A = B except for one element 
Ars = Deg + k. Then the elements of A~! are: a’? = 4 — he 
1+ kbs" 


The row rank of a matrix A is defined as the number of linearly independent 
rows of A. Likewise, the column rank equals the number of linearly indepen- 
dent columns of A. For any matrix, the row rank equals the column rank. 

If A € R”*” has rank of n, then A is said to have full rank. 

A square matrix is invertible if and only if it has full rank. 

Rank(AB) < min [rank(A), rank(B)]. 

Rank(A™ A) = rank(AA‘) = rank(A). 
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2.4.9 SYSTEMS OF LINEAR EQUATIONS 


1. If A is a matrix then Ax = b is a system of linear equations. If A is square 
and non-singular, there exists a unique solution x = A~'b. 
2. For the linear system Ax = b involving n variables and m equations 


A411 + 42%2 +++ + A1m%m = by, 
(2.4.16) 
Ani X1 + An2%2Q + +++ + 4nmtm = bn, 


the possible outcomes when searching for a solution are: 
(a) A unique solution exists, and the system is called consistent. 
(b) No such solution exists and the system is called inconsistent. 
(c) Multiple solutions exist, the system has an infinite number of solutions, 
and the system is called undetermined. 


3. The solvability cases of the linear systems Ax = b (when A is m x n) are: 


(a) If rank(A) = m = n, then there is a unique solution. 

(b) Ifrank(A) = m < n, then there is an exact solution with free parameters. 

(c) If rank(A) = n < m, then either there is a unique solution, or there is a 
unique least squares solution. 

(d) If rank(A) < m < n, or rank(A) < n < m, or rank(A) < n = m: 
then either there is an exact solution with free parameters, or there are 
non-unique least squares solutions. 


4. Fredholm’s alternative 
Either Ax = b has a solution or yA = 0 has a solution with y'b # 0. 
5. If the system of equations Ax = b is underdetermined, then we may find the 
x that minimizes || Ax — b]|,, for some p. 
EXAMPLE ifA=[1 1 1]'andb=[bi bz b3]' withb: > b2 > b3 > 0 
then the minimum value of || Ax — bl], in different norms is as follows: 
p=1 > Xoptima = be 
p=2 => Xoptima = (b1 + be + b3)/3 (2.4.17) 
P= CO => Xoptimal = (b1 ale b3)/2 
6. The condition number of the square matrix A is 


cond(A) = ||A*|| ||Al| (2.4.18) 





where A* is the pseudo-inverse of A and ||-|| is any of the L? norms. When A 
is non-singular, this is equivalent to 


cond(A) = ||A~|] || Al]. (2.4.19) 


In all cases, cond(A) > 1. When cond(A) is equal to one, A is perfectly 
conditioned. Matrices with small condition numbers are well-conditioned. If 
cond(A) is large, then A is ill-conditioned. 


Ue 


8. 


0: 
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For the system of equations (A + €f')x(e) = (b+ ef), the solution satisfies 
I[x(e) — x(0)]| ( IF || BT 2 
——___— < cond(A) ( «——~ + «_— ] + O(e*). (2.4.20) 
I|x(0) | |Al] —— [|bI| 
For a square matrix, the size of its determinant is not related to its condition 


number. For example, the n x m matrices below have k.o(Bn) = n2”—1 and 
det(Bn) = 1; kp(Dn) = 1 and det(D,) = 10~”. 


Bn=|. 0. , Dy = diag0-*, 2.2, 10-*): 

Let A = (aj) be ann X n thatrix. Using the L? condition number we find 
cond A = max; |A;(A)| / min; |A;(A)|: 

Matrix Anyxn = (aij) 

A is orthogonal 

aij = noig +1 

ayy = (i+ j)/p, n=p-—1,paprime 

The circulant whose first row is (1,2,...,7) 

i/j ifti<sj 


Qij : a 3 
g/t ifi> 9 


ifi=j 


if |i — 3] > 2 


aij = 2min(i,j) — 1 





aij =(i+j7—1)7! (Hilbert matrix) 


2.4.10 MATRIX EXPONENTIALS 


1. 


On 


Matrix exponentiation is defined as (the series always converges): 
At)? (At)3 
etary ary AO aa +! 





(2.4.21) 


. Common properties of matrix exponentials are: 


(a) (eA) (e4*) = eAlstt) | (c) eM = Ae*t, 


(b) (e4t) (e~4t) =H 


. When A and B are square matrices C = [B,A] = BA -— AB. is the 


commutator of A and B. Note that e4+?) = e4e?eC/? provided that 
(C, A] = [C, B] = 0 (e., each of A and B commute with their commuta- 
tor). In particular, if A and B commute then eAtB — eAeB 


. Fora matrix A € R”*” det (e“*) — edit ed2t... eAnt — ptr(A)t. 
. The diagonalization of e4*, when A is diagonalizable, is e4’ = Se?'S-1 


where the columns of S' are the eigenvectors of A, and the entries of the diag- 
onal matrix D are the corresponding eigenvalues of A, that is, A= SDS~1. 


96 


CHAPTER 2. ALGEBRA 


2.4.11 LINEAR SPACES AND LINEAR MAPPINGS 


I, 


2. 


A subspace is the space generated by linear combinations of any set of rows 
or set of columns of a real matrix. 

Let R(A) and N(A) denote, respectively, the range space and null space of an 
m x n matrix A. They are defined by: 


R(A) = {y | y = Ax; forsome x € R”}, 


N(A) = {x € R” | Ax =0}. (2.4.22) 


. The projection matrix, onto a subspace S', denoted Ps, is the unique square 


matrix possessing the three properties: 
(a) Py = PE, 
(b) P32 = Pg (the projection matrix is idempotent); 
(c) The vector bg lies in the subspace S if and only if bs = Psv for some 
vector v. In other words, bg can be written as a linear combination of the 
columns of Ps. 


. When the m x n matrix A (with n < m) has rank n, the projection of A onto 


the subspaces of A is given by: 
Pra) = A(A‘A)~*AT, 
Prat) = I, (2.4.23) 
Pyat) = I — A(ATA)“* AT. 
When A is of rank m, the projection of A onto the subspaces of A is given by: 
Pra) = I, 
Prat) = A'(AAT)“1A, (2.4.24) 
Pyay = I — A‘(AAt)“TA, 





. When A is not of full rank, the matrix AA satisfies the requirements for a 


projection matrix, where A is the coefficient matrix of the system of equations 
x, = Ab, generated by the least squares problem min ||b — Ax(||3. Thus, 


Prat) = AA, 
Pya) = 1 - AA, 
Pycaty = 1— AA. 


(2.4.25) 


. Amatrix B € R”*” is called similar to a matrix A € R”*" if B = T-!AT 


for some non-singular matrix T’. 


. If Bis similar to A, then B has the same eigenvalues as A. 
. If B is similar to A and if x is an eigenvector of A, then y = T~!x is an 


eigenvector of B corresponding to the same eigenvalue. 
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2.4.12 GENERALIZED INVERSES 


1. 


nn 


10. 


Every matrix A (singular or non-singular, rectangular or square) has a general- 
ized inverse, or pseudo-inverse, At defined by the Moore—Penrose conditions: 





AAtA=A, 
ee 2.4.26 
(AAt)T = AAT, cee 
(At A)? = ATA. 


. There is a unique pseudo-inverse satisfying the conditions in (2.4.26). If (and 


only if) A is square and non-singular, then At = AW}. 


. If Ais a rectangular m x n matrix of rank n, with m > n, then A* is of order 


nx mand AtA =I € R"*”. In this case A? is called a left inverse, and 
AAt £1. 





. If Ais arectangular m x n matrix of rank m, with m <n, then A™ is of order 


nx mand AAt =I € R™*"™, In this case At is called a right inverse, and 
AtAZ I. 


. For a square singular matrix A, AAt A J,and ATAF I. 
. The matrices AA* and A* A are idempotent. 
. The least squares problem is to find the x that minimizes ||y — Ax||,. The x of 


least norm isx = Aty. 


. The pseudo-inverse is ill-conditioned with respect to rank changing perturba- 


tions. For example 


(b aj+b dy -36 3 


. Computing the pseudo-inverse: The pseudo-inverse of Aj, can be deter- 


mined by the singular value decomposition A = UV". If A has rank r > 0, 
then nxn has r positive singular values (;) along the main diagonal extend- 
ing from the upper left-hand corner and the remaining components of » are 
zero. Then At = (UXV")* = (V)*E*Ut = VEU" since (V")t =V 
and U* = UT because of their orthogonality. The components of in S* are 


— ae ifo; £0; 


r (2.4.27) 
0, if Oo, = 0. 


a 
Computing the pseudo-inverse: Let Am yn be of rank r. Select r rows and 
r columns which form a basis of A. Then compute the pseudo-inverse of 
A as follows: invert the regular r x r matrix and place the inverse (without 
transposing) into the r rows corresponding to the column numbers and the r 
columns corresponding to the row numbers of the basis, and place zero into 
the remaining component positions. For example, if A is of order 5 x 4 and 
rank 3, and if rows 1, 2, 4 and columns 2, 3, 4 are selected as a basis of A, then 
A? will be of order 4 x 5 and will contain the inverse components of the basis 
in rows 2, 3, 4 and column 1, 2, 4, and zeros elsewhere. 
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2.4.13 EIGENSTRUCTURE 


I. 


If A is a square n x n matrix, then the n™ degree polynomial defined by 
det (A — AI) = 0 is called the characteristic polynomial, or characteristic 
equation of A. 


. The n roots (not necessarily distinct) of the characteristic polynomial are 


called the eigenvalues (or characteristic roots) of A. Therefore, the values, 
i,t = 1,...,n, are eigenvalues if and only if |A — A;J| = 0. 


. The characteristic polynomial det (A — AJ) = 37.5 r;X° has the properties 


= (—1)", 
Mm-1 = —Tntr(A), 


tra = —5 [rma tr(A) tn tA?) 





oe -} [Pana tt(A) + rat tr(A2) +79 tr(A3)] , 





. Each eigenvalue \ has a corresponding eigenvector x (different from 0) that 


solves the system Ax = Ax, or (A — AJ)x = 0. 


. If x solves Ax = Xx, then so does yx, where ¥ is an arbitrary scalar. 
. Cayley—Hamilton theorem: Any matrix A satisfies its own characteristic 


equation. That is }7j_,7;A’ = 0. 


. If Ais areal matrix with positive eigenvalues, then 


Aein( AA") < [Amin (A)]? < Amant Ag? < Apeet Ad), (2.4.28) 


where Amin denotes the smallest and A;ax the largest eigenvalue. 


. If all the eigenvalues of a real symmetric matrix are distinct, then their associ- 


ated eigenvectors are also distinct (linearly independent). 


. The determinant of a matrix is equal to the product of the eigenvalues. That is, 


if A has the eigenvalues 1, A2,..-, An, then det (A) = AiA2°+- An. 


. The following table shows the eigenvalues of specific matrices 


matrix eigenvalues 


diagonal matrix diagonal elements 


upper or lower triangular diagonal elements 


Ais n x n and nilpotent 0 (nm times) 


Ais n x nand idempotent of rank r | 1 (r times); and 0 (n — r times) 


(a — b)In + bJn, where J, is the a+(n—1)b;anda—b(n-1 
nm X n matrix of all 1’s times) 
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11. The eigenvalues of a triangular (or diagonal) matrix are the diagonal compo- 
nents of the matrix. 

12. The eigenvalues of idempotent matrices are zeros and ones. 

13. Real symmetric and Hermitian matrices have real eigenvalues. 

14. Let A have the eigenvalues {\1, 2,..., An}. The eigenvalues of some func- 
tions of A are shown below: 


Al eigenvalues of A 
Al complex conjugates of {A}, \S,..., Ak} 
A*, k an integer sb Oe | eee cd 


A-*, k an integer, A non-singular ina pas eee 


q(A), gis a polynomial FaP) G8 jens G Ah} 
SAS~!, S non-singular eigenvalues of A 


AB, where A is m x n, B is eigenvalues of BA; and 0 (m — n times) 
nxm,andm>n 





2.4.14 MATRIX FACTORIZATIONS 


1. Singular value decomposition (SVD): Any m x n matrix A can be written as 
the product A = UV", where U is an m x m orthogonal matrix, V is an 
n x n orthogonal matrix, and © = diag(o1, 02,...,@p), with p = min (m,n) 
and 01 > 02 > ++: > op = 0. The values o;, 1 = 1,...,p, are called the 
singular values of A. 





(a) When rank(A) = r > 0, A has exactly r positive singular values, and 
Or41 = = 0p = 0. 

(b) When A is a symmetric n x n matrix, then a1 = |Ai|, ---, On = |An 
where 1, A2,.-., An are the eigenvalues of A. 

(c) When A is an m x n matrix, if m > n then the singular values of A 
are the square roots of the eigenvalues of A’ A. Otherwise, they are the 
square roots of the eigenvalues of AAT. 


2. Schur decomposition: If A € C"*” then A = UTU#, where U is a unitary 
matrix and 7’ is an upper triangular matrix which has the eigenvalues of A 
along its diagonal. 

3. OR factorization: If all the columns of A € R™*" are linearly independent, 
then A can be factored as A = QR, where Q € R™*” has orthonormal 
columns and R € R"*” is upper triangular and non-singular. 

4. If A € R"*” is symmetric positive definite, then 





’ 


A=LDL' =LpD2p12L7 = (Lp¥?) (zp¥)" = ac" 


where L is a lower triangular matrix and D is a diagonal matrix. The Cholesky 
factorization is A = GG" where the matrix G' is the Cholesky triangle. 

5. Any m x n matrix A can be factored as PA = LU, where P is a permutation 
matrix, L is lower triangular, and U is upper triangular. 
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2.4.15 MATRIX DIAGONALIZATION 


1 


If A € R"*” possesses n linearly independent eigenvectors x1, ..., Xn, then 
A can be diagonalized as S~!AS = A = diag(A1,..., An), where the eigen- 
vectors of A are chosen to comprise the columns of S. 





. If A € R”™” can be diagonalized into S~1AS = A, then A* = SA*S—!, or 


AX = 6-1 A's, 


. Spectral decomposition: Any real symmetric matrix A € R”™*” can be diago- 


nalized into the form A = UAU", where A is the diagonal matrix of ordered 
eigenvalues of A such that Ay > Ag > --+ > An, and the columns of U are the 
corresponding n orthonormal eigenvectors of A. 

That is, if A € R”*” is symmetric, then a real orthogonal matrix Q exists such 
that QTAQ = diag(Ai,..., An) = diagonal matrix with {;} on the diagonal. 


. The spectral radius of a real symmetric matrix A, commonly denoted by p(A), 


is defined as p(A) = maxi<i<n |Ai(A)]. 


. If A € R"*”" and B € R"*" are diagonalizable, then they share a common 


eigenvector matrix S if and only if AB = BA. (Not every eigenvector of A 
need be an eigenvector for B, e.g., the above equation is always true if A = J.) 


. Schur decomposition: If A € C”*", then a unitary matrix Q € C”*” exists 


such that Q7AQ = D+ N, where D = diag(A;,...,,) and N € C”™” is 
strictly upper triangular (i.e., there are zeros on the diagonal). The matrix Q 
can be chosen so that the eigenvalues A; appear in any order along the diagonal. 


. If A € R”*” possesses s < n linearly independent eigenvectors, it is similar 


to a matrix with s Jordan blocks (for some matrix M/) 


7 0 
J=M-1AM = i‘ ; 


0 


where each Jordan block J; is an upper triangular matrix with (a) the single 
eigenvalue A; repeated n; times along the main diagonal; (b) (n; — 1) 1’s 
appearing above the diagonal entries; and (c) all other components zero: 


,» 1 O 


co : (2.4.29) 


Te 
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2.4.16 QUADRATIC FORMS 


I. 


10. 


. The ratio of two quadratic forms (B non-singular) u(x) = 


For a symmetric matrix A, the map x +> x! Ax is called a pure quadratic form. 
It has the form 
n n 
7 be hed es 2 2 
x Ax = AjyjgLjL; = A141 LY + A12%1 XQ + Gq1 22X71 + +++ + AnnXy,.- 
i=1 j=l 


(2.4.30) 


. For A symmetric, the gradient of x’ Ax/x'x equals zero if and only if x is 


an eigenvector of A. Thus, the stationary values of this function (where the 
gradient vanishes) are the eigenvalues of A. 
(x? Ax) /(x! Bx) 
attains stationary values at the eigenvalues of B~.A. In particular, 

Umax = Nie OA), 


and Unmin = dnin(B-*A). 


. A matrix A is positive definite if x' Ax > 0 for all x 4 0. 
. A matrix A is positive semi-definite if x' Ax > 0 for all x. 
. For a real, symmetric matrix A € R”*”, the following are necessary and 


sufficient conditions to establish the positive definiteness of A: 


(a) All eigenvalues of A have \; > 0, fori = 1,...,”, and 
(b) The upper-left sub-matrices of A, called the principal sub-matrices, de- 
fined by A; = [an], 


a11 412 Gin 
a a 
Ass a4 a2 As = 21 422 2n 
2. ; n= . F ‘ ; 
421 422 : : 
Anl1 aAn2 ann 


have det(Aj;,) > 0, for all & = 1,...,n. 


. If A is positive definite, then all of the principal sub-matrices of A are also 


positive definite. Additionally, all diagonal entries of A are positive. 


. For a real, symmetric matrix A € R”*”, the following are necessary and 


sufficient conditions to establish the positive semi-definiteness of A: 


(a) All eigenvalues of A have \; > 0, fori = 1,...,n, 
(b) The principal sub-matrices of A have det Ay, > 0, forall k =1,...,n. 


. If A is positive semi-definite, then all of the principal sub-matrices of A are 


also positive semi-definite. Additionally, all diagonal entries of A are non- 
negative. 

If the matrix Q is positive definite, then (x' — x})Q7'(x — xo) = 1 is the 
equation of an ellipsoid with its center at x}. The lengths of the semi-axes are 
equal to the square roots of the eigenvalues of Q; see page 234. 
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2.4.17 THEOREMS 


1. Frobenius—Perron theorem: If A > 0 (that is, aj; > 0) then there exists \p > 0 
and xo > 0 such that 


(a) Axo = AoXo, 

(b) if \ is any other eigenvalue of A, A ~ Xo, then |A| < Ao, and 

(c) Ao is an eigenvalue with geometric and algebraic multiplicity equal to 
one. (That is, there is no x1 4 xo with Ax, = \ox1.) 


2. If A > 0 (that is, a;; > 0), and A* > 0 for some positive integer k, then the 
results of the Frobenius—Perron theorem apply to A. 


3. Courant—Fischer minimax theorem: If d;(A) denotes the i“ largest eigenvalue 
of a matrix A = AT € R”*”, then 


TA 
Aj (A) = max — 


min —— ee 
S; 04xeS; x!x 


Pasen (2.4.31) 
where x € R” and S; is a j-dimensional subspace. 

From this follows Raleigh’s principle: The quotient R(x) = x! Ax/x'x is 
minimized by the eigenvector x = x; corresponding to the smallest eigenvalue 
A; of A. The minimum of R(x) is 1, that is, 

















: _ x! Ax xfAx, = xf Ai X1 
min R(x) = min a R(x1) = a = me =. (2.4.32) 
4. Cramer’s rule: The j" component of x = A~'b is given by 
det B; 
ler 7 ; where 
G11 G12 «ee AL G-1 by Q1j4+1 «++ Gin (2.4.33) 
B= ‘ : : ; 
Gn1 Gn2 +++ Gn j-1 bn Qn j+l +++ Ann 
The vector b = [b1 dod bn] replaces the Gi column of the matrix A to 


form the matrix B;. 

5. Sylvester’s law of inertia: For a symmetric matrix A € R"*"”, the matrices A 
and C' AC, for C non-singular, have the same number of positive, negative, 
and zero eigenvalues. 

6. Gerschgorin circle theorem: Each eigenvalue of an arbitrary n x n matrix 
A = (aj;) lies in at least one of the circles {C1, C2,...,Cn} in the complex 

n 


plane, where circle C;; has center a;; and radius p; given by p; = s |aiy|. 
j=1 


jFi 
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2.4.18 THE VECTOR OPERATION 


The matrix A, can be represented as a collection of m x 1 column vectors: A = 


[ai a... a,,| . Define Vec A as the matrix of size nm x 1 (i.e., a vector) by 
ay 
a2 
an 


This operator has the following properties: 


1. tr AB = (Vec AT)" Vec B. 
2. The permutation matrix U that associates Vec X and Vec X 7 (that is, 
Vec XT = U Vec X) is given by: 


U=([VecE], VecE}, ... VecHl,])= > Ere® Ey. (2.4.35) 


3. Vec(AY B) = (B™ @ A) Vec YY. 

4. If A and B are both of size n x n, then 
(a) Vec AB = (In ® A) Vec B. 
(b) Vec AB = (B™ @ A) Vec In. 


2.4.19 KRONECKER SUMS 


If the matrix A = (a,;) has size n x n and matrix B = (b;;) has size m x m, then 
the Kronecker sum of these matrices, denoted A @ B, is defined! as 


A®B=A@In+In® B. (2.4.36) 


The Kronecker sum has the following properties: . 
1. If A has eigenvalues {\;} and B has eigenvalues {j1;}, then A @ B has eigen- 


values {A; + pu;}. 
2. The matrix equation AX + X B = C' may be equivalently written as 


(BT @ A) Vec X = Vec C, where Vec is defined in Section 2.4.18. 
3. cA®B = eA @ePF, 





'Note that A @ B is also used to denote the (m +n) x (m +n) matrix ie 3 ; 
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2.4.20 KRONECKER PRODUCTS 


If the matrix A = (aij) has size m x n, and the matrix B = (b;;) has size r x s, 
then the Kronecker product (sometimes called the tensor product) of these matrices, 
denoted A @ B, is defined as the partitioned matrix 


ay4B aj2B AjnB 
a2,B a92B Ag,B 
AQ@B= ; . ‘ (2.4.37) 
QmiBo adm2B AmnB 
Hence, the matrix A @ B has size mr x ns. 
EXAMPLE 1A=|@ @?| andB = [2 22] then 
a2 a22 bai b22 
aiibi1 aiibig ss ai2b11 ai 2bi2 
auB ay2B @11b21  @11b22 a12b21 ai2be2 
A®S®B= = 2.4.38 
2 ine | a2ibi1 G@2ibi2 a22b11— az2bi2 ( ) 
@21b21 G21b22 d22b21 ~ a22be2 


The Kronecker product has the following properties: 


1. Ifz and w are vectors of appropriate dimensions, then 


Az® Bw=(A® B)(z@w). 


2. If ais a scalar, then (aA) ® B= A® (AaB) =a(A® B) 
3. The Kronecker product is distributive with respect to addition: 


(a) (A+ B)@C=A®C+B@C,and 


(b) A@(B+C)=A@B+AQC. 


4. The Kronecker product is associative: A®@ (B®C)=(A@®B)@C. 


5, (Ag By) =A eB". 


6. The mixed product rule: If the dimensions of the matrices are such that the 
following expressions exist, then (A @ B)(C ® D) = AC’ ® BD. 

7. If the inverses exist, then (A @ B)~'= A! @ Be. 

8. If {A;} and {x;} are the eigenvalues and the corresponding eigenvectors for 
A, and {1;} and {y,} are the eigenvalues and the corresponding eigenvectors 
for B, then A ® B has eigenvalues {; 1; } with corresponding eigenvectors 


{Xi & y;}- 


9. If matrix A has size n x n and B has size m x m, then det(A ® B) = 


(det A)” (det B)”. 


10. If f is an analytic matrix function and A has size n x n, then 


(a) fUn @ A) = In ® f(A), and 


11. tr(A @ B) = (tr A)(tr B). 


12. If A is similar to C and B is similar to D, then A © B is similar to C ® D. 
13. If C(t) = A(t) ® B(t), then S = 4 QpyAg®. 
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2.4.21 MATRIX PSEUDOSPECTRA 


Let A be a complex n x n matrix. The spectra (or eigenvalues) of A, denoted A(A), 
is the collection of values such that zJ — A is singular; that is det(zI — A) = 0. 


A(A) = {z € C | det(zI — A) = 0} 


By convention the norm of (zJ — A)~? is infinite at the eigenvalues. 
The pseudospectra of A, denoted A,(A), is those values for which the norm of 
zI — Ais very large; the following definitions are equivalent: 
A,(A) = {z EC | ||(2 - A)~"|| > et} 
={zEC|zeEA(A+BE) for some F with || || < €} 
={zEC|||(A-—zlI)v||<e forsome v € C” with ||v|| = 1} 
where |]-|| is a matrix norm induced by a vector norm. 

A pseudospectral image shows outlines of the A,.(A) regions in the complex 
plane. Normal matrices (e.g., those for which A* A = AA*; such as unitary, Her- 
mitian, orthogonal, and symmetric matrices) have pseudospectral images that are 
qualitatively different than those of non-normal matrices. The images can be used, 
for example, to estimate how accurately the eigenvalues have been computed. 


In the figures below A,(A) is shown for € = 10~',10~?,...,10~1°. The axes 
are different in each image. 


e Some normal matrices 


ee 
111 
111 


e Some non-normal matrices 
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2.5 ABSTRACT ALGEBRA 


Zine! 


iF 
2. 


DEFINITIONS 
A binary operation on a set S isa functionx: Sx SS. 
An algebraic structure (S,*1,...,*n) consists of a non-empty set S' with one 


or more binary operations x; defined on S. If the operations are understood, 
then the binary operations need not be mentioned explicitly. 

The order |S| of an algebraic structure S is the number of elements in S. 

A binary operation « on an algebraic structure (5, *) may have the following 
properties: 


(a) Associative: ax (bc) = (axb)xcforalla,b,ceE S. 

(b) Identity: there exists an element e € S (identity element of S’) such that 
exa=axe=aforallacS. 

(c) Inverse: a~+ € Sis an inverse of aifaxa7! =a7!xa=e. 

(d) Commutative (or Abelian): if ax b = bx a foralla,be S. 


A semigroup (S,*) consists of a non-empty set S' and an associative binary 
operation x on S. 

A monoid (S,*) consists of a non-empty set S with an identity element and 
an associative binary operation x. 


2.5.1.1 Examples of semigroups and monoids 


1. 








The sets N = {0,1,2,3,...} (natural numbers), Z = {0,+1,+2,...} (in- 
tegers), Q (rational numbers), R (real numbers), and C (complex numbers) 
where x is either addition or multiplication are semigroups and monoids. 

The set of positive integers under addition is a semigroup but not a monoid. 
If A is any non-empty set, then the set of all functions f : A + A where x is 
the composition of functions is a semigroup and a monoid. 

Given a set S, the set of all strings of elements of S, where x is the concatena- 
tion of strings, is a monoid (the identity is A, the empty string). 








2.5.2 GROUPS 


1. 


A group (G, x) consists of a set G with a binary operation « defined on G' such 
that « satisfies the associative, identity, and inverse laws. Note: The operation 
x is often written as + (an additive group) or as - or x (a multiplicative group). 


(a) If + is used, the identity is written 0 and the inverse of a is written —a. 
Usually, in this case, the group is commutative. The following notation 
na=a-+...+ ais then used. 

—— 


n times 


(b) If multiplicative notation is used, a x b is often written ab, the identity is 


often written 1, and the inverse of a is written a~!. 
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. The order of a € G is the smallest positive integer m such that a” = 1 where 


a” =a-a---a(ntimes) (ora+a+---+a = Oif G is written additively). 


If there is no such integer, the element has infinite order. In a finite group of 
order mn, each element has some order /; (depending on the particular element) 
and it must be that k divides n. 


. (H, x) is a subgroup of (G, x) if H C G and (H, x) is a group (using the same 


binary operation as in (G, x)). 


. The cyclic subgroup (a) generated by a € Gis the subgroup {a" |n€ Z} = 


{...,a-? = (a1)?, a1, a° = e,a,a”,...}. The element a is a generator of 
(a). A group G is cyclic if there is a € G such that G = (a). 


. If H is a subgroup of a group G, then a left [right] coset of H in G is the set 


aH = {ah|h€ H}[Ha= {ha|he H}}). 


. Anormal subgroup of a group G' is a subgroup H such that aH = Ha for all 


aeG. 


. A simple group is a group G' # {e} with only G and {e} as normal subgroups. 
. If H is a normal subgroup of G, then the quotient group (or factor group) of 


G modulo H is the group G/H = {aH | a € G}, with binary operation 
aH - bH = (ab)H. 


. A finite group G is solvable if there is a sequence of subgroups G; = 


G,G2,...,Gz_1, with G, = {e}, such that each G41 is a normal subgroup 
of G; and G;/Gj+1 is Abelian. 


2.5.2.1. Facts about groups 


I, 
. Each element has exactly one inverse. 
. Each of the equations a x « = b and x x a = b has exactly one solution, 


The identity element is unique. 


z=a 'xbandz=bxa!. 


og) * =e: 
. (axb)t=b 1 xa. 
. The left (respectively right) cancellation law holds in all groups: If axb = axc 


then b = c (respectively, if bx a = cx a then b = c). 


. Lagrange’s theorem: If G is a finite group and H is a subgroup of G, then the 


order of H divides the order of G. 


. Every group of prime order is Abelian and hence simple. 

. Every cyclic group is Abelian. 

. Every Abelian group is solvable. 

. Feit-Thompson theorem: All groups of odd order are solvable. Hence, all 


finite non-Abelian simple groups have even order. 


. Finite simple groups are of the following types: 


(a) Zp (p prime) 

(b) A group of Lie type 

(c) An (n > 5) 

(d) Sporadic groups (see table on page 120) 
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2.5.2.2 Examples of groups 


1. 
. For na positive integer, nZ = {nz | z € Z} is an additive group. 
. Q— {0} = O, R— {0} = R*, C — {0} = C’, with « the multiplication of 


10. 


Z, Q, R, and C, with « the addition of numbers, are additive groups. 


numbers, are multiplicative groups. 


. Zn = Z/nZ = {0,1,2,...,n — 1} is a group where x is addition modulo n. 
. Z, = {k | k € Z,,k has a multiplicative inverse (under multiplication mod- 


ulo n) in Z,,} is a group under multiplication modulo n. If p is prime, Zi, is 
cyclic. If p is prime and a € LZ, has order (index) p — 1, then a is a primitive 
root modulo p. 


. If (G1, *1), (Go, *2),---,(Gn,*n) are groups, the (direct) product group is 


(Gy x Gg xX +++ X Gn, x) = {(a1,@2,.--,@4n) | a; € Gi,i = 1,2,...,n} 
where x is defined by 
(G1, d2,..-,@n) * (b1, be,..., bn) = (a1 #1 by, a2 *2 bg,..+,n *n bn). 


. All m x n matrices with real entries form a group under addition of matrices. 
. All n x n matrices with real entries and non-zero determinants form a group 


under matrix multiplication. 


. All 1-1, onto functions f : S — S (permutations of S), where S is any non- 


empty set, form a group under composition of functions. See Section 2.5.3. 
In particular, if S = {1,2,3,...,n}, the group of permutations of S is 
called the symmetric group, S;,. In S;,, each permutation can be written as 
a product of cycles. A cycle is a permutation 0 = (i; ig --- ix), where 
o(t1) = 12, 0(t2) = t3,...,0(t%) = t1. Each cycle of length greater than 1 
can be written as a product of transpositions (cycles of length 2). A permuta- 
tion is even (odd) if it can be written as the product of an even (odd) number of 
transpositions. (Every permutation is either even or odd.) The set of all even 
permutations in S,, is a normal subgroup, A,,, of S,,. The group A,, is called 
the alternating group on n elements. 

Given a regular n-gon, the dihedral group D,, is the group of all symme- 
tries of the n-gon, that is, the group generated by the set of all rotations 
around the center of the m-gon through angles of 360k/n degrees (where 
k = 0,1,2,...,n — 1), together with all reflections in lines passing through 
a vertex and the center of the n-gon, using composition of functions. Alter- 
nately, D, = {ab |4 =0,1; 7 = 0,1,...,n—1; aba“! = 671}. 


2.5.2.3 Matrix classes that are groups 


In the following, the group operation is ordinary matrix multiplication: 


1. 


2 
3. 
4 


Nn 


GL(n,C) all complex non-singular n x n matrices 
. GL(n,R) all real non-singular n x n matrices 
O(n) orthogonal group, all n x n matrices A with AAT = I 
. SL(n,C) all complex n x n matrices of determinant 1, also called 
the unimodular group or the special linear group 
. SL(n,R) all real n x m matrices of determinant 1 
. SO(2) planar rotations: matrices of the form [6°57 ~ 5" @ | 


; : lab]. 
. non-Abelian matrices of the form [3 i | witha,b,cE R 


2.5. ABSTRACT ALGEBRA 109 


2.5.3 PERMUTATION GROUPS 


Symbol 


Symmetric group ! All permutations on {1,2,...,p} 
Alternating group ! All even permutations on {1, 2,...,p} 
Cyclic group Generated by (12--->p) 
Dihedral group Generated by (12---p) and 

(1p)(2p — 1)(3p — 2)--- 
Identity group (1)(2) --- (p) is the only permutation 





EXAMPLE The 16 elements in the Dg group can be illustrated as 


GSOSOTEOSS 
OSOeSwsesd 


2.5.3.1 Creating new permutation groups 


Assume A has permutations {X;}, order n, degree d, B has permutations {Y;}, 
order m, degree e, and C' = C(A, B) have permutations {W;,}, order p, degree f. 


Sum C=A+BI|W=XUY 
Product | C= peo W=XxY 








2.5.3.2 Polya theory 


Let 7 be a permutation. Define Inv (7) to be the number of invariant elements (i.e., 
mapped to themselves) in 7. Define cyc (7) as the number of cycles in 7. Suppose 7 
has b; cycles of length 1, bz cycles of length 2, ..., by cycles of length & in its unique 
cycle decomposition. Then 7 can be encoded as the expression a oP? mes alk . Sum- 
ming these expressions for all permutations in the group G, and normalizing by the 
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number of elements in G results in the cycle index of the group G: 
1 
Po(a1,¥2,...,21) = a Ce ae (2.5.1) 
TEG 


1. Burnside’s lemma: Let G be a group of permutations of a set A, and let S be 

the equivalence relation on A induced by G. Then the number of equivalence 
1 
classes in A is given by Gq ye Inv (7). 
TEG 

2. Special case of Polya’s theorem: Let R be an m element set of colors. Let 
G be a group of permutations {71, 72,...} of the set A. Let C(A, R) be the 
set of colorings of the elements of A using colors in R. Then the number of 
distinct colorings in C(A, R) is given by 


=| 
— fm) 4 eye (m2) 4, 
IG| 
3. Polya’s theorem: Let G be a group of permutations on a set A with cycle index 
Po(#1,%2,...,@,). Let C(A, R) be the collection of all colorings of A using 
colors in R. If w is a weight assignment on R, then the pattern inventory of 
colorings in C(A, R) is given by 


Pg & w(r), > w'(r),.° ~, Ho) : 


reR reR reR 


EXAMPLES 


1. Consider necklaces constructed of 2k beads. Since a necklace can be flipped over, 
the appropriate permutation group is G = {71,72} with 7, = (1)(2)...(2k) and 
m2 = (1 2k)(2 2k—1)(3 2k-2)...(k k+1). Hence, cye(m) = 2k, 
cyc (72) = k, and the cycle index is Pg(x1, 22) = (xj* + x5) /2. Using r colors, 
the number of distinct necklaces is (r?" + r*) /2. 





For a 4-bead necklace (& = 2) using r = 2 colors (say wi = 6 for “black” and w2 = w 
for “white”), the (24 + 27) /2 = 10 different necklaces are {bbbb}, {bbbw}, {bbwb}, 
{bbww}, {bwbw}, {bwwb}, {wbbw}, {bwww}, {wbww}, and {wwww}. The pat- 
tern inventory of colorings, Pe(S>, wi, 0, wi) = ((b+w)* + (0? +w7)?) /2 = 
b? + 2b? w + 4b? w? + 2bw*® + w%, tells how many colorings of each type there are. 


2. Consider coloring the corners of a square. If the squares can be rotated, but not re- 
flected, then the number of distinct colorings, using k colors, is + (ee 4+ he + 2k). If 
the squares can be rotated and reflected, then the number of distinct colorings, using k 
colors, is z (ie + 2k? + 3k? + 2k). 


(a) If k = 2 colors are used, then there are 6 distinct classes of colorings whether 
reflections are allowed, or not. These classes are the same in both cases. The 16 
colorings of a square with 2 colors form 6 distinct classes as shown: 
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+ 
= 
€ 





i. 
is 
Ed 
i 
ic 


(b) IfkK=3 Guinness are ‘aaa hen rere are 21 distinct classes of éolgnings if elieeiion 
are allowed, and 24 distinct classes of colorings if reflections are not allowed. 
Shown below are representative elements of each of these as 


Ed | 
- 
Ed 


O 
@ 
Q 
@) 


fe) 
Oo) 
(2) 
‘O) 
O 
® 


Dat de 
hd deal 


a 
i 


Of 


a 


i/o 
Med 


< include these 3 for no reflections case 


f=) 
®) 


ie 
e 


DO 
f=) 
D 


3. Number of distinct corner colorings of regular polygons using rotations and reflections, 
or rotations only, with no more than k colors: 


rotations & reflections rotations only 
object | k=2 k=3 k=4/kK=2 k=3 & 
triangle 








square 
pentagon 
hexagon 





4. Coloring regular 2- and 3-dimensional objects with no more than k colors: 


(a) tetrahedron 


i. corners of a tetrahedron 4 (k° + 3k4 + 8k") 
ii. edges of a tetrahedron = (k° + 3k* +4 8k") 
ili. faces of a tetrahedron — (ke + 11k*) 
(b) cube 


i. corners of a cube om (k® + 17k* + 6k”) 
ii. edges of a cube — (e + 6K" + 3k° + 8k4 + 6k*) 
ili. faces of a cube ~ (k° + 3k* + 12k3 + 8k?) 





(c) corners of a triangle 


i. with rotations 3 (k° + 2k) 
ii. with rotations and reflections z (k? + 3k° + 2k) 
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(d) corners of a square 
1. with rotations 
ii. with rotations and reflections 


(k* +k? + 2k) 
(k* + 2k° + 3k? + 2k) 





(e) corners of an n-gon 





i. with rotations - Daln P(a)ka 
ii. with rotations and reflections (n odd) + dain o(d)ka + 3k =ar 


iii. with rotations and reflections (n even) 
2 n nt2 
X Dan ADR 40 +t (hE +e) 
5. The cycle index P(a1, x2,...) and number of black-white colorings 
of regular objects under all permutations: 





(a) corners of a triangle 
i. cycle index i (ai + 321%2 + 2x3) 
ii. pattern inventory 1b? + 1b?w + lbw? + Iw? 


(b) corners of a square 








i. cycle index z (et + Qa3a2 + 302 + 24) 
ii. pattern inventory 1b* + 1b? w + 2b? w? + lbw? + 1w* 





(c) corners of a pentagon 
i. cycle index — (x? + 4a5 + 5123) 
ii. pattern inventory 1b° + 1b*w + 2b? w? + 2b?w? + lbw* + lw? 
(d) corners of a cube 
i. cycle index — (a$ +623 + 9a5 + 8723) 
ii. pattern inventory 
BS +b’ w + 3b°w? + 3b°w? + 7b4w4 + 3b? w? + 3b?w® + bw" + w® 


Note that the pattern inventory for the black-white colorings is given by 
P((b+w), (0? + w?), (b? + w),...). 


2.5.4 BRAID GROUPS 


A braid group represents how threads can be braided together. Consider the case 
n = 4; given 4 threads we can switch the order of two adjacent threads in 3 ways: 





—.. .—« — 

—_—"-—e * -..--* . . 

-—____-« ---—e ee 

* . * e - —s6 
O1 02 03 


These operations can be combined via composition. We note the properties: 

@ 0103 = 0301 

@ 010201 = 020102 

@ 020302 = 030203 
Abstracting these relations, the braid group on n strands (B,,) consists of the ele- 
ments (or generators) {o1,...,n—1} with the following relations: 


Oj07j = O505 for |i —j| >2 


Oj,Oj4104 = 44107 0{41 for 1 < 1 < n—2 
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2.5.5 RINGS 
2.5.5.1. Definitions 


1. 


11. 


12. 


3: 


14. 


15. 


A ring (R,+,-) consists of a non-empty set R and two binary operations, + 
and -, such that (R, +) is an Abelian group, the operation - is associative, and 
the left distributive law a(b + c) = (ab) + (ac) and the right distributive law 
(a + b)c = (ac) + (bc) hold for all a, b,c € R. 

A subset S of aring R is a subring of Rif S'is a ring using the same operations 
used in R with the same unit. 

A ring R is a commutative ring if the multiplication operation is commutative: 
ab = ba foralla,b€ R. 

A ring R is a ring with unity if there is an element 1 (called unity) such that 
al=1la=aforallac R. 

A unit in a ring with unity is an element a with a multiplicative inverse a~ 
(that is, aa~t = a~ta = 1). 

If a £ 0, b £ 0, and ab = 0, then a is a left divisor of zero and b is a right 
divisor of zero. 


1 


. Asubset J of a ring (R, +, -) is a (two-sided) ideal of R if (I, +) is a subgroup 


of (R, +) and J is closed under left and right multiplication by elements of R 
afaéelandre€ R,thenrx € J andar € 1). 
An ideal J C Ris 

(a) Proper: if 1 A {0} andl AR 

(b) Maximal: if I is proper and if there is no proper ideal properly containing [ 

(c) Prime: if ab € I implies that a or 6b € I 

(d) Principal: if I is the intersection of all ideals containing an element a € R 


If I is an ideal in a ring R, then a coset isasetr +I ={r+a|ae TJ}. 

If J is an ideal in a ring R, then the quotient ring is the ring R/I = {r+ I | 
r © R}, where (r+ J) +(s4+J) = (r+s)+J and (r+J)(s+J) = (rs) +1. 
An integral domain (R,+,-) is a commutative ring with unity such that can- 
cellations hold: if ab = ac then b = c (respectively, if ba = ca then b = c) 
for all a, b, c € R, where a # 0. (Equivalently, an integral domain is a 
commutative ring with unity that has no divisors of zero.) 

If R is an integral domain, then a non-zero element r € F that is not a unit is 
irreducible if r = ab implies that either a or 0 is a unit. 

If R is an integral domain, a non-zero element r € F that is not a unit is 
a prime if, whenever r|ab, then either r|a or r|b (a|y means that there is an 
element z € F such that y = zz.). 

A unique factorization domain (UFD) is an integral domain such that every 
non-zero element that is not a unit can be written uniquely as the product of 
irreducible elements (except for factors that are units and except for the order 
in which the factor appears). 

A principal ideal domain (PID) is an integral domain in which every ideal is a 
principal ideal. 
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A division ring is a ring in which every non-zero element has a multiplicative 
inverse (that is, every non-zero element is a unit). (Equivalently, a division 
ring is a ring in which the non-zero elements form a multiplicative group.) A 
non-commutative division ring is called a skew field. 


2.5.5.2 Facts about rings 


if 


2 


3: 


The set of all units of a ring is a group under the ring multiplication operation. 
Every principal ideal domain is a unique factorization domain. 
If R is a commutative ring with unity, then 


(a) every maximal ideal is a prime ideal. 
(b) Ris a field if and only if the only ideals of R are R and {0}. 
(c) I is a maximal ideal if and only if R/T is a field. 


. If R is a commutative ring with unity and J # R is an ideal, then R/J is an 


integral domain if and only if [ is a prime ideal. 


. If f(a) € F[x] (where F is a field) and the ideal generated by f(z) is not {0}, 


then the ideal is maximal if and only if f(a) is irreducible over F’. 


. There are exactly four normed division rings, they have dimensions 1, 2, 4, 


and 8. They are the real numbers, the complex numbers, the quaternions, and 
the octonions. The quaternions are non-commutative and the octonions are 
non-associative. 


2.5.5.3 Examples of rings 


1. 


pz 
3. 


Z (integers), Q (rational numbers), R (real numbers), and C (complex num- 
bers) are rings, with ordinary addition and multiplication of numbers. 

Zm is a ring, with addition and multiplication modulo n. 

If \/n is not an integer, then Z[,/n] = {a + b/n | a,b € Z}, where (a + 
b/n) + (c+ d/n) = (a+c) + (6+ d)J/n and (a + b/n)(e+ d/n) = 
(ac + nbd) + (ad + bc),/n is a ring. 





. The set of Gaussian integers Z{i] = {a + bi | a,b € Z} is a ring, with the 


usual definitions of addition and multiplication of complex numbers. 


. The polynomial ring in one variable over a ring R is the ring R{a] = {a,a2" + 


“+ +a," + a9 | a; € R; i =0,1,...,n; n © N}. (Elements of R[2] are 
added and multiplied using the usual rules for addition and multiplication of 
polynomials.) The degree of a polynomial a,2" +-+-+a12+4a witha, 4 0 
is n. A polynomial is monic if a, = 1. A polynomial f(x) is irreducible over 
Rif f(x) cannot be factored as a product of polynomials in R[x] of degree 
less than the degree of f(a). A monic irreducible polynomial f(a) of degree 
k in Zp[2] (p prime) is primitive if the order of x in Z,[a]/(f(x)) is p* — 1, 
where (f(x)) = {f(x)g(x) | g(x) € Z,[ax]} (the ideal generated by f(x)). 
For example, the polynomial x? + 1 is 


(a) Irreducible in R[x] because x? + 1 has no real root 


(b) Reducible in C[z] because x? + 1 = (x — i)(x + 7) 
(c) Reducible in Z2[2] because x? + 1 = (x + 1)? 
(d) Reducible in Z5[x] because x? + 1 = (x + 2)(x + 3) 
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6. The division ring of quaternions is the ring ({a + bi + cj + dk | a,b,c,d € 
IR}, +,-), where operations are carried out using the rules for polynomial addi- 
tion and multiplication and the defining relations for the quaternion group Q. 

7. Every octonion is a real linear combination of the unit octonions {1, e1, e2, e3, 
€4, €5, €6, €7}. Their properties include: (a) e? = —1; (b) exe; = —eje; when 
i # Jj; (c) the index doubling identity: eye; = ex = > e2:€2; = e2x3 and 
(d) the index cycling identity: eye; =e, => ej41€j;41 = ex+1 Where the 
indices are computed modulo 7. The full multiplication table is as follows: 

1 e1. €2 é€3 €4 €5 €6 e7 


a ee ee 
ex | -1| ea] ez | ~e2| 6 | ~es | es | 
ez |e | -1] es | ex | ~es | er | ~ee | 
| es | ~er | ~es | -1| es ca | ~ea| er | 
ea | e2 | ~en | ~es | ~1] er | es | ~es | 
es | ~es | es | ~e2 | ~er | ~1] er| ea | 
es | es | ~er | ea | ~es | ~ex | -1 ea | 
er] es} es | ~er] es | ~ea | ~e2 | —1 | 


8. The following table gives examples of rings with additional properties: 


Commuta- | Integral | Principal | Euclidean | Division | Field 
tive ring domain | ideal domain ring 
with unit domain 

yes 





aad 


a (p prime) 

Z», (n composite) 
Z\q] 

Mnx n 





2.5.6 FIELDS 
2.5.6.1 Definitions 


1. A field (F',+,-) is a commutative ring with unity such that each non-zero ele- 
ment of F has a multiplicative inverse (equivalently, a field is a commutative 
division ring). 

2. A finite field is a field that contains a finite number of elements. 

3. The characteristic of a field (or a ring) is the smallest positive integer n such 
that 1 + 1+.---+1 = 0 (mn summands). If no such n exists, the field has 
characteristic 0 (or characteristic 00). 

4. Field K is an extension field of the field F' if F'is a subfield of K (1.e., FC Kk, 
and F’ is a field using the same operations used in K). 


2.5.6.2 Examples of fields 
1. QR, and C with ordinary addition and multiplication are fields. 
2. Zy (pa prime) is a field under addition and multiplication modulo p. 
3. F[x]/(f(«x)) is a field, provided that F’ is a field and f(z) is a non-constant 
polynomial irreducible in F'[2’]. 
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2.5.7 QUADRATIC FIELDS 
2.5.7.1. Definitions 


I. 


2. 


A complex number is an algebraic integer if it is a root of a polynomial with 
integer coefficients that has a leading coefficient of 1. 

If d is a square-free integer, then Q(Vd) = {a + bVd}, where a and 6 are 
rational numbers, is called a quadratic field. If d > 0 then Q(Vd) is a real 
quadratic field; if d < 0 then Q(Vd) is an imaginary quadratic field. 


. The integers of an algebraic number field are the algebraic integers that belong 


to this number field. 


. If {a, 8, y} are integers in Q(Vd) such that ay = G, then we say that a 


divides B; written al. 


. An integer € in Q(V/d) is a unit if it divides 1. 
. Ifa =a + bvd then 


(a) the conjugate of a is = a — bVd. 
(b) the norm of ais N(a) = a@ = a? — db’. 


. If a is an integer of Q(Vd) and if € is a unit of Q(/d), then the number ea 


is an associate of a. A prime in Q(Vd) is an integer of Q(Vd) that is only 
divisible by the units and its associates. 


. A quadratic field Q(/d) is a Euclidean field if, given integers a and ( in 


Q(Vd) with 8 ¢ 0, there are integers y and 6 in Q(Vd) such that a = 78 +6 
and | (5)| < |N(8)|. 


. A quadratic field Q(V/d) has the unique factorization property if, when- 


ever a is a non-zero, non-unit, integer in Q(Vd) with a = em 79°::Tp = 
em - ++ 7, where € and ¢’ are units, then r = s and the primes 7; and 7; can 
be paired off into pairs of associates. 


2.5.7.2 Facts about quadratic fields 


1s 


The integers of Q(Vd) are of the form 
(a) a+ bV4d, with a and b integers, ifd= 2 mod 4ord=3 mod 4. 
(b) a+b — 1), with a and b integers, if d= 1 mod 4. 





. Norms are positive in imaginary quadratic fields, but not necessarily positive 


in real quadratic fields. It is always true that N(a@B) = N(a)N({). 


. If a is an integer in Q(V/d) and N(q) is an integer that is prime, then a is 


prime. 


. The number of units in Q(Vd) is as follows: 








(a) If d = —3, there are 6 units: +1, ais , and + ee ll 

(b) If d = —1, there are 4 units: +1 and c 

(c) Ifd <Oandd ¢ —1 andd F¥ —3 there are 2 units: +1. 

(d) If d > 0 there are infinitely many units. There is a fundamental unit, €o, 
such that all other units have the form teG where n is an integer. 





























. The quadratic field Q(/d) is Euclidean if and only if d is one of the following: 


11, —7, —3, —2, —1, 2, 3,5, 6, 7, 11, 13, 17, 19, 21, 29, 33, 37, 41, 57, 73. 





6. 
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If d < 0 then the imaginary quadratic field Q (va) has the unique factoriza- 


tion property if and only if d is one of the following: —1, —2, —3, —7, —11, 
—19, —43, —163. 





. Of the 60 real quadratic fields Q(vad) with 2 < d < 100, exactly 38 of them 


have the unique factorization property: d = 2, 3, 5, 6, 7, 11, 13, 14, 17, 19, 
21, 22, 23, 29, 31, 33, 37, 38, 41, 43, 46, 47, 53, 57, 59, 61, 62, 67, 69, 71, 73, 
77, 83, 86, 89, 93, 94, and 97. 


2.5.7.3 Examples of quadratic fields 


1. 


2. 


The algebraic integers of Q(./—1) are of the form a + bi where a and b are 
integers; they are called the Gaussian integers. 

The number 1+ 2 is a fundamental unit of Q(/2). Hence, all units in Q(/2) 
have the form +(1 + V2)” for n = 0,+1,+2,.... 

















. The field Q (v= ya is not a unique factorization domain. This is illustrated by 


6=2-3= (1+ /—5)- (1 — V—5), yet each of {2, 3,1 + /—5, 1 — /—5} 


is prime in this field. 





. The field Q (Vv 10) is not a unique factorization domain. This is illustrated by 


6 =2-3 = (4+ V10)- (4— 10), yet each of {2,3,4+ 10, 4 — V/10} is 


prime in this field. 


2.5.8 FINITE FIELDS 
2.5.8.1 Facts about finite fields 


1. 
2. 


. If F is a finite field where |F'| = k and p 


If p is prime, then the ring Z, is a finite field. 

If p is prime and n is a positive integer, then there is exactly one field (up to 
isomorphism) with p” elements. This field is denoted GF (p”) or Fy» and is 
called a Galois field. (See the table on page 127.) 


. For Fa finite field, there is a prime p and a positive integer n such that F’ has 


p” elements. The prime number p is the characteristic of F’. The field Fis a 
finite extension of Zp, that is, F’ is a finite dimensional vector space over Zp. 


. If F isa finite field, then the set of non-zero elements of F’ under multiplication 


is acyclic group. A generator of this group is a primitive element. 


. There are ¢(p" —1)/n primitive polynomials of degree n (n > 1) over GF'(p), 


where ¢ is the Euler ¢-function. (See table on page 46.) 


. There are (305), W(k/ j)p™)/k irreducible polynomials of degree k over 


GF (p”), where ju is the Mobius function. 

(x) is a polynomial of degree n 
irreducible over F’, then the field F'[x]/(p(x)) has order k”. If a is a root of 
p(x) € F [a] of degree n > 1, then F[x]/(p(x)) = {cn-1a”~-1 +--+ +c1a+ 
co | c, € F for all z}. 


. When p is a prime, GF'(p”) can be viewed as a vector space of dimension 


n over F,. A basis of F,» of the form {a, a”, QP”, fee ap" } is called a 
normal basis. If ~ is a primitive element of F),n, then the basis is said to be a 
primitive normal basis. Such an q satisfies a primitive normal polynomial of 
degree n over Fy. 
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2.5.9 HOMOMORPHISMS AND ISOMORPHISMS 
2.5.9.1 Definitions 


1, 


Nn 


A group homomorphism from group G to group G2 is a function y : G; > 
Gp such that y(ab) = y(a)y(b) for all a,b € G,. Note: av is often written 
instead of (a). 


. A character of a group G is a group homomorphism x : G — C* (non-zero 


complex numbers under multiplication). (See table on page 128.) 


. A ring homomorphism from ring R, to ring Rz is a function y : Ry > Re 


such that y(a + b) = y(a) + v(b) and y(ab) = y(a)y(b) for all a,b € Ry. 


. An isomorphism from group (ring) 5S; to group (ring) Sz is a group (ring) 


homomorphism y : 5S; — Sz that is 1-1 and onto Sg. If an isomorphism 
exists, then S is said to be isomorphic to Sz. Write S; ~ Sp. (See the table 
on page 119 for numbers of non-isomorphic groups and the table on page 121 
for examples of groups of orders less than 16.) 


. An automorphism of S is an isomorphism y : S > S. 
. The kernel of a group homomorphism y : G; — G2 is yp +(e) = {g € 


Gi | v(g) = e}. The kernel of a ring homomorphism y : Ri > Reo is 
p-*(0) = {r € Ri | y(r) = 0}. 


2.5.9.2 Facts about homomorphisms and isomorphisms 


1. 
2. 


Nm sf WwW 


10. 


11. 


If py: Gy > Gp» is a group homomorphism, then y(G) is a subgroup of Go. 
Fundamental homomorphism theorem for groups: lf p : Gi > G2 isa 
group homomorphism with kernel K, then K is a normal subgroup of G; and 
Gi/K = 9(G1). 


. If Gis a cyclic group of infinite order, then G © (Z, +). 

. If Gis a cyclic group of order n, then G & (Z,,, +). 

. If pis prime, then there is only one group of order p, the group (Zy,+). 

. Cayley’s theorem: If G is a finite group of order n, then G is isomorphic to 


some subgroup of the group of permutations on n objects. 


. Zm X Zn = Zmn if and only if m and n are relatively prime. 
. Ifn = 71 -ng-...+ Mm, where each n; is a power of a different prime, then 


Zm = Zing X Zing X +++ X Any. 


. Fundamental theorem of finite Abelian groups: Every finite Abelian group G 


(order > 2) is isomorphic to a product of cyclic groups where each cyclic 
group has order a power of a prime. That is, there is a unique set {n1,...,%} 
where each n; is a power of some prime such that G = Z,, X Zn. +++ X Zn,. 
Fundamental theorem of finitely generated Abelian groups: If G is a finitely 
generated Abelian group, then there is a unique integer n > O and a unique set 
{n1,...,«} where each n; is a power of some prime such that G © Z,,, x 
Zn X +++ X Zn, x Z" (Gis finitely generated if there are a1, d2,...,4n € G 
such that every element of G can be written as ay. ai. vee ay. where kj € 
{1,...,n} (the k; are not necessarily distinct) and €; € {1,—1}). 

Fundamental homomorphism theorem for rings: If p : Ry — Reg is a ring 
homomorphism with kernel /’, then K is an ideal in Ry and Ri /K & y(R). 
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2.5.10 TABLES 
2.5.10.1| Number of non-isomorphic groups of different orders 


The 10n + k entry is is found by looking at row n_ and the column _k. For example, 
there are 267 non-isomorphic groups with 64 elements. 
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2.5.10.2 Number of non-isomorphic Abelian groups of different 


orders 


The 10n + k entry is is found by looking at row n_ and the column _k. 








2.5.10.3 List of all sporadic finite simple groups 


These are the sporadic finite simple groups that are not in any of the standard classes 


(see page 107). 


27 .37.5-11 
26.33 .5.11 

20+ 3255272 11 

2’ .37.5.7-11-23 


910 7 


33.5-7-11-23 


23-3-5-7-11-19 
ES ee ae 
27.3°.5-17-19 


921 . 


3°-5+7-113-23-29-31-37-43 


29 632587 oT 
27. 36.53.11 


913 . 
gl4 . 


910, 
28.37 .56.7.11-31-37-67 
29 .34.5.73.11-19-31 


921 


bo 


wD bw 





No NNN WY WD 


37.5?-7-11-13 
38.52: 7-13-29 
S250. 7 


BP eh v7" 9 11+ 182 25 
pes ae fe ee 6 eee 
BF 2.5P 3% 11293 
£B.8t. Fe 11213 


. 315 .52.7.11-13-17-23 

316.52. 73.11.13. 23-29 

BNO 58 <7 < 13 <19 231 

36. 58.7.11-19 

318.56. 72.11-13-17-19- 23-31-47 


- 370.59. 76. 117. 133 -17-19-23-29-31-41-47-59-71 
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2.5.10.4 Names of groups of small order 


Distinct groups of order n 


{e} 

C2 

C3 

C2 x Co, C4 
C5 

Ce, D3 

Cr 


Cy x C2 x C2, Co x Cu, Cg, Q, Da 


C2 x Ce, Cio, Aa, Deg, / i C3 x C4 
Cis 

Cia, Dz 

C15 





2.5.10.5 Representations of groups of small order 


In all cases the identity element, {1}, forms a subgroup of order 1. 


1. Cg, the cyclic group of order 2 
Generator: a with relation a? = 1 


1a Elements 
1 (a) order 2: a 
aja 1 
Subgroups 


(a) order 2: {1, a} 


2. C3, the cyclic group of order 3 
Generator: a with relation a® = 1 


Elements 
: (a) order 3: a, a? 
a 
a? Subgroups 





(a) order 3: {1, a, a?} 
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3. C4, the cyclic group of order 4 
Generator: a with relation a* = 1 


Elements 
3 


Qe 


(a) order 4: a, a 
(b) order 2: a? 


aa 
won 


Subgroups 


(a) order 4: {1,a,a?,a*} 
(b) order 2: {1,a?} 





4. V, the Klein four group 
Generators: a, b with relations a? = 1, b? = 1, ba = ab: 


Elements 
(a) order 2: a, b, ab 
Subgroups 


(a) order 4: {1, a, b, ab} 
(b) order 2: {1, a}, {1, b}, {1, ab} 





5. Cs, the cyclic group of order 5 
Generator: a with relation a? = 1 
Elements 
(a) order 5: a, a?, a?, a4 
Subgroups 
(a) order 5: {1,a,a?,a°,a*} 





6. Cg, the cyclic group of order 6 
Generator: a with relation a® = 1 


1 aia a at a Elements 
: ’ . (a) order 6: a, a? 
e ce (b) order 3: a?, a4 
is (c) order 2: a? 
Subgroups 





(a) order 6: {1,a,a?,a3,a*, a>} 
(b) order 3: {1a" a} 
(c) order 2: il,a°} 
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7. Sg, the symmetric group with three elements 
Generators: a, b with relations a? = 1, b? = 1, ba = a~!b 





Elements 


(a) order 3: a, a? 


(b) order 2: b, ab, ab 


Subgroups 
(a) order 6: {1,a, a”, b, ab, a7b} (is a normal subgroup) 
(b) order 3: {1, a, a?} (is a normal subgroup) 


(c) order 2: {1, b}, {1, ab}, {1,a7b} 
8. C7, the cyclic group of order 7 
Generator: a with relation a’ = 1 


1 aia a a a @ |Elements 
1} 1 aia a 
(a) order 7: a, a?, a?, a*, a?, a® 

ala a a 

a? a a Subgroups 

3 
os ss (a) order 7: {1,a,a?,a?,a*,a®,a°} 
a a 
nP 
ao 





9. Cg, the cyclic group of order 8 
Generator: a with relation a® = 1 





1 aa@a ata a a 

1 1. ca 2G" a? aa a 

ala @ @ at @ a 1 

ala a at a a® a a 

a®|}a2 at a a®& at 1 a? 

a*+|}a* a a? a 1 a a? 

a |a a® a 1 aa a* 

ala a 1 a@ @& a 

ala’ 1 a @ a at a® 

Elements Subgroups 

(a) order 8: a, a2, a®, a? (a) order 8: {1,a,a?,a?,a*,a°,a°,a™} 
(b) order 4: a?, a® (b) order 4: {1,a?,a*,a°} 


(c) order 2: a* (c) order 2: {1,a*} 
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10. C'4 x Cg, the direct product of a cyclic group of order 4 and a cyclic group 
of order 2 
Generators: a, b with relations a* = 1, 6? = 1, and ba = ab 





Elements 


(a) order 4: a, a®, ab, a®b 
(b) order 2: a?, b, a?b 


Subgroups 
(a) order 8: {1, a, a?,a°, b, ab, a7b, a3b} 
(b) order 4: {1,a,a?,a?} {1, ab, a?,a?b} {1,a?,b,a?b} 
(c) order 2: {1,a7}, {1, b}, {1, 7b} 
11. C2 x Cz x Co, the direct product of 3 cyclic groups of order 2 


Generators: a, b, c with relations a? = 1, b? = 1, c? = 1, ba = ab, ca = ac, 
cb = bc 








a b ab Cc ac be abe 





Elements 
(a) order 2: a, b, ab, c, ac, be, abc 
Subgroups 


(a) order 8: {1, a,b, ab, c, ac, bc, abc} 

(b) order 4: {1, a,b, ab}, {1, a,c, ac}, {1, a, bc, abc}, {1, b, c, bc}, 
{1,b, ac, abc}, {1, ab, c, abc}, {1, ab, ac, bc} 

(c) order 2: {1, a}, {1, db}, {1, ab}, {1, c}, {1, ac}, {1, bc}, {1, abc} 
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12. D4, the dihedral group of order 8 
Generators: a, b with relations a* = 1, b? = 1, ba = a~1'b 





Elements 


(a) order 4: a, a? 


(b) order 2: a”, b, ab, a2b, ab 
Normal subgroups 
(a) order 8: {1,a,a?,a*, b, ab, a?b, ab} 
(b) order 4: {1,a?,b,a?b}, {1,a,a7,a?}, {1,a?, ab, a°b} 
(c) order 2: {1,7} 
Additional subgroups 
(a) order 2: {1,b}, {1,a7b}, {1, ab}, {1, a3d} 


13. Q, the quaternion group (of order 8) 
Generators: a, b with relations a* = 1, b? = a?, ba = a~!b 











Elements 
(a) order 4: a, a®, b, ab, a2b, a3b 
(b) order 2: a? 
Subgroups (all of them are normal subgroups) 
(a) order 8: {1, a, a?,a°, b, ab, a?b, a3} 
(b) order 4: {1,a,a?,a?}, {1,b,a?, ab}, {1, ab, a?, a°b} 
(c) order 2: {1,7} 
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Notes 
e (can be defined as the set {1, —1,i, —i, j, —j, k, —k} where multiplica- 
tion is defined by: 7? = j? = k? = -1,ij7 = —ji =k, jk = —kj =i, 
and ki = —ik = 7. This is an alternate group representation with: 
— Elements 
* order 4: i, —7, 7, —j, k, —k 
* order 2: —1 
— Subgroups (all of them are normal subgroups) 
* order 8: {1,—1,%, -i, 7, -—j,k, —k} 
* order 4: {1,7,—-1, —7}, {1,7, -1, —j}, {1, &, -1, —k} 
* order 2: {1,—1} 




















e Q can be defined as the group composed of the 8 matrices: 


1 0 -1 0] ,, _f-i 0] _. _fi 0 
H1e= [5 a] »-te= |G S) =f i »-= [b a 


__fo 4}. fo = 0 1 0: 
tie= [foie [Eo] tee LE ge ft ol 


where a subscript of qg indicates a quaternion element, i? = —1, and 
matrix multiplication is the group operation. 


| 





2.5.10.6 Small finite fields 
In the following, the entries under a’ denote the coefficient of powers of a. For 


example, the last entry of the p(x) = x? + x? + 1 table is 110. That is: a® = 
la? + 1a’ + 0a° modulo p(a), where the coefficients are taken modulo 2. 
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2.5.10.7 Addition and multiplication tables for F>, F3, Fy,, and Fx 


(a) fF, addition and multiplication: 


0 : 1 
0 1 0 0 
1 0 1;0 1 


(b) F3 addition and multiplication: 


Holt 


Ne ot 
i) =) 
ON FR 
PON NM 





8S DBoHr 
HOD RIS 
Ore ue 





Wr ot 
WRrRaASO 





(d) fg addition and multiplication (using strings of Os and 1s to represent the poly- 
nomials: 0 = 000, 1 = 001, a = 010,a+ 1 = 011, a? = 100, a? + a = 110, 
a? +1=101,a7+a+1=111): 


+ | 000 O01 O10 O11 100 101 110 111 





000 O01 O10 O11 100 101 110 111 
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2.5.10.8 Linear characters 


A linear character of a finite group G' is a homomorphism from G to the multiplica- 
tive group of the non-zero complex numbers. Let y be a linear character of G, let v 
be the identity of G and assume g,h € G. Then 


x(t) =1 x(g* h) = x(g)x(h) x(g~*) = x(a) 


x(g) = e27k/" for some integer k, where n is the order of g 


The trivial character of G maps every element to 1. If v1 and x2 are two linear char- 
acters, then so is y = 1X2 defined by y(g) = v1(g)x2(g). The linear characters 
form a group. 


Cy Form =0,1,....»-1, Y¥m:kH e2tikm/n 


G Abelian G=Zn, X Zny X +++ X Zn, with each n; a power of a prime. 
For m; =0,1,...,n; — land g; = (0,...,0,1,0,...,0) 


Xmi1,M2,...,Mn * Gj 





if n even, 
1 ifn odd, 
Xx2,y i at> xv,b++ y. (See definition of D,,.) 


D,, dihedral Forz=+ 











Quaternions For «+1 andy = +1 or $1, 


fo 1 et 6 
Xa yy * i 0 > 2, Xa,y * 0 4 ry 


S, symmetric | The trivial character and sgn, where sgn is the signum function 
on permutations. (See Section 5.12.2.) 








2.5.10.9 Indices and power residues 


For Z;, the following table lists the index ne of a and the power residues a, a’, 
aindex(a) — 1 for each element a, where (a,n) = 1. 


Group | Element | Index Power Group | Element | Index Power 
ane residues 


Zi aA 
er hes 
ae ea 


4,2,1 
Zs 1 
2 ‘ 
3 4 3.4.2.1 
. ; = 


5,4,6,2,3,1 
a Ee 


6,1 


NTYMNWRINDN NB WN ke 


1 
3 
6 
3 
6 
2 
1 
2 
2 
2 
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2.5.10.10 Power residues in Z, 


For prime p < 40, the following table lists the minimal primitive root a and the 
power residues of a. These can be used to find a™ (mod p) for any (a, p) = 1. For 
example, to find 3’ (mod 11) (a = 3,m = 7), look in row p = 11 until the power 
of a that is equal to 3 is found. In this case 2° = 3 (mod 11). This means that 
37 = (28)? = 256 = (210)5 . 968 = 296 = 9 (mod 11). 


| p | a | Power residues 


4 20 
13. 19 





2.5.10.11 Primitive normal polynomials 



























































130 CHAPTER 2. ALGEBRA 


2.5.10.12 Table of primitive monic polynomials 


In the table below, the elements in each string are the coefficients of the polynomial 
after the highest power of x. (For example, 564 represents 2° + 527 + 6x + 4.) 
Fy 0 
11 
O11 101 
0011 1001 
00101 01001 = Ol1111 10111 11011 11101 
000101 011011 100001 100111 101101 110011 


0 
12 





2.5.10.13 Table of irreducible polynomials in Z2(z| 


Each polynomial is represented by its coefficients (which are either 0 or 1), begin- 
ning with the highest power. For example, «+ + x + 1 is represented as 10011. 
degree 1: 10 
degree 2: 111 
degree 3: 1011 
degree 4: 10011 11001 11111 
degree 5: 100101 101001 101111 110111 111011 111101 
degree 6: 1000011 1001001 1010111 1011011 1100001 1100111 


1101101 1110011 1110101 
degree 8: 100011011 100011101 100101011 100101101 100111001 100111111 
101001101 101011111 101100011 101100101 101101001 101110001 
101110111 101111011 110000111 110001011 110001101 110011111 
110100011 110101001 110110001 110111101 111000011 111001111 
111010111 111011101 111100111 111110011 111110101 111111001 
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2.5.10.14 Table of primitive roots 


The number of integers not exceeding and relatively prime to the integer n is ¢(n) 
(see page 46). These integers form a group under multiplication module n; the group 
is cyclic if and only if n = 1,2,4 or n is of the form p* or 2p*, where p is an odd 
prime. The number g is a primitive root of n if it generates that group, i.e., if {g, 9”, 
...,g°™} are distinct modulo n. There are ¢(¢(n)) primitive roots of n. 


1. If g is a primitive root of p and g?~' #1 (mod p”), then g is a primitive root 
of p* for all k. 

2. If g?-! =1 (mod p?) then g + pis a primitive root of p* for all k. 

3. If g is a primitive root of p”, then either g or g + p*, whichever is odd, is a 
primitive root of 2p". 

4. If g is a primitive root of n, then g” is a primitive root of n if and only if k and 
@(n) are relatively prime, ie., (¢(n),&) = 1. 


In the following table, 


e g denotes the least primitive root of p 
e G denotes the least negative primitive root of p 
e € denotes whether 10, —10, or both, are primitive roots of p 











103 
109 
127 





137 
149 
157 
167 
179 


191 
197 
211 
227) 2-113 
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2.5.10.15 Table of factorizations of x” — 1 


n Factorization of x” — 1 mod 2 


























+a) (l-a+a?-23+2*) (l+r+a*%4+23+2*) 
Fatartertet+e®°+e% +a +084 0942" 
+2) (1+27) (1—2+27) (1+2+42?) (1-2? +27) 
a 

+2) (l-ax+a?-234+24-2° +2°) 

bai tatta° + 2°) 

fo+a*) (l+a+a%+23 +24) 

gt Lt gt 4g 




















a*) (1 gw? +a4—76 + 78 


a) (lt+e4+e? +23 +24+2°+ 2°) 
po — a8 429 — gl + gl?) 











Eg nn ge deg a eh ig a9 Lg 


pal tat tao $06 $27 +08 $29 +29) 
—1+2) (peer 











x x 4 





8 — 9 4 gl _ gl 4 x!) 


t a> +? 4 

















| a) (1 at+a?—-a2+e*-—754+ 7% 
+ 2° + 28) (1-2? +24 — 26 + 28 — 719 + g!2) 
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3.1 SETS 


A set can be thought of as a collection of objects. Examples of sets are: 


1. The people in Boston on January 1, 2018 

2. The real numbers between 0 and | inclusive 
3. The numbers 1, 2, 3, and 4 

4. All of the formulas in this book 


Commonly used sets of numbers include the following: 











N positive integers (also known as natural numbers) 
Z, integers 
Q rational numbers (quotients of integers) 
R real numbers 
—oo, +00] extended reals 
Cc complex numbers 
Note tha: NCZCQCRCC. 


Formal set theory can be defined by the (Zermelo—Fraenkell) axioms: 


1. Axiom of Extensionality 6. Axiom of Infinity 

2. Axiom of the Unordered Pair 7. Axiom of Replacement 
3. Axiom of Subsets 8. Axiom of Foundation 
4. Axiom of the Sum Set 9. Axiom of Choice 

5. Axiom of the Power Set 


3.1.11 SET OPERATIONS AND RELATIONS 


If x is an element of a set A, then we write x € A (read “x is in A.”) If x is not 
in A, we write  ¢ A. When considering sets, a set U called the universe, is chosen, 
from which all elements are taken. The null set or empty set Q is the set containing 
no elements. Thus, x ¢ §) for all x € U. 


Relation Read as Definition 
ACB Aiscontainedin B All elements of A are also elements of B 
A=B  Aequals B (A C B) and (B C A) 


Basic set operations include: 


1. The union of the sets A and B, denoted AU B, are all the elements that are in 
A or are in B. The intersection of the sets A and B, denoted AM B, are all 
the elements in both A and B. 

Distributive laws: Intersection and union distribute over each other. That is: 
AN (BUC) =(ANB)U(ANC) 
AU(BNC)=(AUB)N (AUC) 


for all sets A, B,C. 


(3.1.1) 
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2. Given the set X, the power set of X is {S | S C X}, the set of all subsets 


of X. The power set of X is written as as P(X) or 2*. 
For example, if X = {0, 1} then P({0, 1}) = {0, {O}, {1}, {0, 1}}. Note that 
P(@) = {0}; the power set of the empty set has one element. 


. If S and X are sets, then the complement of S in X, is represented in many 


different ways: X\S=X-S=S'={xe X andz ¢ S} 
For example, {a, b, c}\{c, d} = {a,b,c} — {c,d} = {c,d}! = {a, b} 
When S is a subset of X, then the complement of S$ in X can be written Cs. 
Qs ras ner, 
(b) Clos = 39 
(c) De Morgan’s Laws for sets: The complement of a union is the intersec- 
tion of complements, and vice versa 


((Us) = 10s), (Ms) = Yes). 


AEA AEA AEA AEA 


(d) There is an order-reversing duality between statements about collections 
of sets and statements about the complements of those sets: 


ACB <= (CBODCA. 


. The symmetric difference of two sets A and B (represented as A @ B or 


AASB) is the set of elements that are in A or B and are not in both A and B 
(i.e., the union minus the intersection). 


AA B=(A\B)U(B\A) 
= (ANCB)U(CANB) 
= (AUB) \ (ANB) 
For example, {a,b,c} A {b, c,d} = {a, d}. Note that: 

(a2) AAB=BAA 
(bs) AAA=90 
(c) AAQ=A 
(d) If {A, B} are subsets of X, then (A A B) = AA (CB) = (CA)A B. 
(e) (CAA)AB = CA(AAB) = {x | x isin one or three of {A, B,C} }. 





3.1.2 CONNECTION BETWEEN SETS AND PROBABILITY 


Set concept Probability concept 

Set Event 

Set containing a single element Indecomposable, elementary, or 
Set with more than one element Compound event 

Universal set or space Sample space 

Complement of a set Non-occurrence of an event 
Function on the universal set Random variable 

Measure of a set Probability of an event 


Integral with respect to the measure Expectation or expected value 
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3.1.3 VENN DIAGRAMS 


The operations and relations on sets can be illustrated by Venn diagrams. The dia- 
grams below show a few possibilities. 


08) (O16) 
(oe 


AcB 
Venn diagrams can be constructed to show combinations of 
many events. Each of the 2+ regions created by the rectangles 
in the diagram to the right represents a different combination. 








3.1.4 PARADOXES AND THEOREMS OF SET THEORY 
3.1.4.1. Russell’s paradox 


Around 1900, Bertrand Russell presented a paradox, paraphrased as follows: since 
the elements of sets can be arbitrary, sets can contain sets as elements. Therefore, a 
set can possibly be a member of itself. (For example, the set of all sets would be a 
member of itself. Another example is the collection of all sets that can be described 
in fewer than 50 words.) Now let A be the set of all sets which are not members of 
themselves. Then if A is a member of itself, it is not a member of itself. And if A is 
not a member of itself, then by definition, A is a member of itself. This paradox led 
to a more careful consideration of how sets should be defined. 

3.1.4.2 Infinite sets and the continuum hypothesis 


Georg Cantor showed how the number of elements of infinite sets can be counted, 
much as finite sets. He used the symbol No (read “aleph null’) for the number of 
integers and introduced larger infinite numbers such as Nj, Xz, and so on. A few of 
his results were as follows (note: the “+” sign below is a set operation) 

No + No = No, (No)? = No, €=2 = NF > Ro. 


where ¢ is the cardinality of real numbers. The continuum hypothesis asks whether 
or not c = Nj, the first infinite cardinal greater than No. In 1963, Cohen showed this 
result is independent of the other axioms of set theory: “... the truth or falsity of the 
continuum hypothesis ... cannot be determined by set theory as we know it today.” 
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FIGURE 3.1 


Left: Hasse diagram for integers up to 12 with x x y meaning “the number «x divides the 
number y.” Right: Hasse diagram for the power set of {a, b, c} with x X y meaning “the set 
x is a subset of the set y.” 





3.1.5 PARTIALLY ORDERED SETS 

Consider a set S and a relation on it. Given any two elements x and y in S, we can 
determine whether or not « is “related” to y; if it is, “a x y.” The relation “X” will 
be a partial order on S if it satisfies the following three conditions: 


reflexive s x sforeverys € S, 
antisymmetric s xtandt =< simply s =¢, and 
transitive sx~tandt X uimply s = wu. 


If X is a partial order on S, then the pair (5, <) is called a partially ordered set 
or a poset. Given the partial order = on the set S, define the relation < by 


u<y if and only if xxyandrF y. 


We say that the element t covers the element s if s < ¢ and there is no element u 
with s < u ~ t. A Hasse diagram of the poset (S, x) is a figure consisting of the 
elements of S' with a line segment directed generally upward from s to t whenever t 
covers s. (See Figure 3.1.) 

Two elements wx and y ina poset (5, X) are said to be comparable if either x =< y 
or y x «. If every pair of elements in a poset is comparable, then (5, <) is a chain. 
An antichain is a poset in which no two elements are comparable (i.e., 7 < y if and 
only if « = y for all x and y in the antichain). A maximal chain is a chain that is not 
properly contained in another chain (and similarly for a maximal antichain). 


EXAMPLES 


1. Let S be the set of natural numbers up to 12 and let “a =< y” mean “the number 
x divides the number y.” Then (.S,~<) is a poset with the Hasse diagram shown in 
Figure 3.1 (left). Observe that the elements 2 and 4 are comparable, but elements 2 and 
5 are not comparable. 


2. Let S be the set of all subsets of the set {a,b,c} and let “a = y” mean “the set x 
is contained in the set y.” Then (S,~<) is a poset with the Hasse diagram shown in 
Figure 3.1 (right). 
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3. There are 16 different isomorphism types of posets of size 4. There are 5 different 
isomorphism types of posets of size 3, shown below: 


a b oe a a a b a 
e@ @ @ @ 
e b 
c 
b b c c c 
3.1.6 INCLUSION/EXCLUSION 


Let {a1, @2,...,a,} be properties that the elements of a set may or may not have. If 
the set has N objects, then the number of objects having exactly m properties (with 
m <1), €m, is given by 


m+1 m+2 m+3 
Em = 8m — 1) Smt + 9 | Smt+2 — 3) Smt3 tees (3.1.2) 
+ r—m + _ 
a (PD?) ame (Yom 


Here s; = )> N(a;, aj, +--+ @;,) is the number of elements that have any ¢ distinct 
properties. When m = 0, this is the usual inclusion/exclusion rule: 


€9 = 89 — 81 + S82 —-°° 4 ( 1)"s, =WN (3.1.3) 
- S- N(a;) + S- N(aja;) — S- N(ajajan) +++: +(-1)"N(a1a2...a,) 


i, 9 distinct i,j,k distinct 





EXAMPLE _Hatcheck problem: distribute n hats to their n owners. Let a; be the property 
that the i person receives their own hat. Then N(aia2...a,) = (n — r)! and so 
st = > N(ai, ain ---ai,) = (7)(n — t)!. Therefore the number of ways in which 
exactly one person gets their own hat back is e; = s1 (7) S24 (3) 83 oe 

1 1 1 (-1)""? 


tl fie ee, ey a A 
nt | iio 3 Ge 





=n Drn-1. (See page 144 for Dn.) 


3.1.7 PIGEONHOLE PRINCIPLE 
Pigeonhole Principle 
If n items are put into m pigeonholes with n > m, then at least one 
pigeonhole must contain more than one item. 
Generalized Pigeonhole Principle 
If n items are put into m containers, then 
e at least one container must hold no fewer than | =] objects; 


e at least one container must hold no more than | | items. 


where [-] and |-| are the ceiling and floor functions. 


EXAMPLES 


e Ifyou select five numbers from the integers | to 8, then two of them must add up to nine. 
e Inany group of two or more people, there must be at least two people who have the same 
number of friends in the group. 
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3.2 COMBINATORICS 


3.2.1 SAMPLE SELECTION 


There are four different ways in which a sample of r elements can be obtained from 
a set of n distinguishable objects: 


~ (n-ry G15 


r-combination C(2,2)=1 = ab 

r-permutation P(2,2)=2 =  abandba 
r-combination with replacement C7(2,2)=3 = aa, ab, and bb 
r-permutation with replacement PQ, 2)=4 +> aa,ab, ba, and bb 


3.2.2 BALLS INTO CELLS 


There are eight different ways in which n balls can be placed into k cells: 


Distinguish Distinguish Cancells | Number of ways to 
the balls? the cells? be empty? place n balls into k cells 














where at is the Stirling subset number (see page 147) and p;(n) is the number of 
partitions of the number n into exactly & integer pieces (see page 145). 

Given n distinguishable balls and /; distinguishable cells, the number of ways in 
which we can place 7, balls into cell 1, nz balls into cell 2, ..., m;% balls into cell k, 


is given by the multinomial coefficient (es ceed (see page 143). 
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EXAMPLE 
Consider placing n = 3 balls into k = 2 cells. Let {A, B, C} denote the names of the 
balls (when needed) and {a, b} denote the names of the cells (when needed). A cell 
will be denoted like this. Begin with: Are the balls distinguishable? 


1. Yes, the balls are distinguishable. Are the cells distinguishable? 


(a) Yes, the cells are distinguishable. Can the cells be empty? 


i. Yes. Number of ways is k” = 2° = 8: ABC ||ABC 


a b b 
Mee el oe Rell oe all ell Ll Dl Bell Le 
a b 


ii. No. Number of ways is k! ey = = 24 


aay oat a 
iL 1 Ll 
b b 


(b) No, the cells are not distinguishable. Can the cells be empty? 
i. ia err Z| aES alee ¥] [E25] 


ii. No. Number of ways is o — ae =3: 
ee | LS L—— LL 


2. No, the balls are not distinguishable. Are the cells distinguishable? 


Ps 


(a) Yes, the cells are distinguishable. Can the cells be empty? 
Ca 1 


(b) No, the cells are not distinguishable. Can the cells be empty? 
i. Yes. Number of ways is pi(n)+...+pe(n) = pi(3 pe =141=2: 


[meee] [see] 


i. Yes. Number of ways is ( 


ii. No. Number of ways is ( 


ii. No. Number of ways is pe(nm) = p2(3) = 1: 
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3.2.3. BINOMIAL COEFFICIENTS 


The binomial coefficient C(n,m) = () is the number of ways of choosing m 


objects from a collection of n distinct objects without regard to order: 


5! 


EXAMPLE For the 5-element set {a, b, c,d, e} there are (3) = sim — 10 subsets con- 
taining exactly three elements. They are: 


{a,b,c}, {a,b,d}, {a,b,e}, {a,c,d}, {a,c,e}, 
{a,d,e}, {b,c,d}, {b,c,e}, {b,d,e}, {c,d,e}. 





Properties of binomial coefficients include: 


‘ (") - ——— = SS = Cn) 


Qn\  2"(2n— 1)! 2"(Qn — 1)(2n—3)---3-1 
( ) n! ~ n! , 
. Ifn and mare integers, and m > n, then (") = 0. 

. The recurrence relation: CS) =(") +674): 

. Two generating functions for binomial coefficients are ye (") Yl 


(1+2)" forn =1,2,...,and 2° (")a*-™ = (1—a)-™ 1. 


7. The Vandermonde convolution is (* : ") = a (;) (." 3 , 


k=0 


An w 


3.2.3.1. Pascal’s triangle 


The binomial coefficients a) can be arranged in a triangle in which each number is 
the sum of the two numbers above it. For example (3) = (7) + (5). 


) 
a (i) (: 
1 : ree : 1 (°) (() (:) 
1 : peer ; 1 (i) () () () 
1 8 28 56 70 56 2881 (*) (‘) (2) (:) (‘) 
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3.2.3.2 Binomial coefficient relationships 


The binomial coefficients satisfy 




















[a Gt Ga 

b a) om) 

. Ce tC eer 

d C= G) HG) tet G) 

f Ce =) GG pera) 

Lf ae) a) ieee (a) 

g O=(")-() +... +(-1)"(°) forn > 1, 
h grt — (*) re (°) 4 (") Bhar forn > 1, 
[i eS GQ) forn > 1, 
li 0=1(5) -2G) +--+ C1)" 'n(") forn > 1. 





3.2.4 MULTINOMIAL COEFFICIENTS 


The multinomial coefficient i i ec) (also written C'(n;1n1,n2,...,mx)) is the 
number of ways of choosing 7 objects, then n2 objects, ..., then n;, objects from a 
collection of n = > 1 nj distinct objects without regard to order. The multinomial 


j 
coefficient is numerically evaluated as 


n n! 
= —_______.. (3.2.2) 
N1,NQ,..-,NK ni! ne! +++ np! 

EXAMPLE The number of ways to choose 2 objects, then | object, then 1 object from 
the set {a, b, c, d} is (sia) = o— — = = 12; they are as follows (vertical bars 
show the ordered selections): 

|ad|cld|, |abljdje, |ac/b|d|, | aca], 
jad|b| cl, jad|c|b|, | be} a| dl, | be| dal, 
|bd| alc, | bd| cla, |cd|a|b|, |ced| bla. 


To count the number of ordered selections assume that there are p types of 
objects with n; indistinguishable objects of type 7 (fori = 1,2,...,p). Then 
the number of distinguishable permutations of length k, with up to n,; objects 
of type i, is the coefficient of x*/k! in the exponential generating function 


(lt+e+ 4004 \ (torte tee) (pee et eee), 


no! Np! 


el 
n1! 








EXAMPLE The number of 2 letter words formed from the set {A, A, B, B, C} is the 
coefficient of = in (1+2+%) (i+2+) (l+2) =14+3¢+44e?+4..., 
or 8. They are: {AA, AB, AC, BA, BB, BC, CA, CB}. 
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3.2.5 ARRANGEMENTS AND DERANGEMENTS 


The number of ways to arrange n distinct objects in a row is n!; this is the number of 
permutations of n objects. For example, for the three objects {a, b,c}, the number 
of arrangements is 3! = 6. These permutations are: abc, bac, cab, acb, bca, and cba. 

The number of ways to arrange n objects (assuming that there are k types 
of objects and n; copies of each object of type 2) is the multinomial coefficient 


( x F For example, for the set {a, a, b, c} the parameters are n = 4, k = 3, 
TU SND ysecy Nk i 
ny = 2,n2 = 1, and n3 = 1. Hence, there are « al = —— 


they are 


= 12 arrangements; 


aabc, aacb, abac, abca, acab, acba, 
baac, baca, bcaa, caab, caba, cbaa. 


A derangement is a permutation of objects, in which object 7 is not in the i" 
location. For example, all of the derangements of {1, 2, 3, 4} are 
2143, 2341, 2413, 
3142, 3412, 3421, 
4123, 4312, 4321. 


The number of derangements of n elements, D,,, satisfies the recursion relation 
Dy = (n= 1) (Dyn-1 + Dy—2) with the initial values D; = 0 and Dz = 1. Hence, 


ta 4 1 
=m! a= = = =])? = 
Dy =n! (1 nt a a er 1) <): 


The numbers D,, are also called sub-factorials or rencontres numbers. For large 
values of n, D;,/n! ~ e~ +! ~ 0.37. Hence more than one of every three permutations 
is a derangement. 


[wllivo4 5 6 7 8 9 10 
129 


| Dn | 0 2 44 265 1854 14833 133496 1334961 


3.2.6 CATALAN NUMBERS 





1 2 4” 
The Catalan numbers are C;, = ee ify large n. One recurrence 
n+1\n n3/2 
relation is: 
Cn = CoCn-1 + CiCn_2 +... + Cn_1Co. (3.2.3) 


0123 4 5 6 7 8 9 10 
1 12 5 


1442 132 429 1,430 4,862 16,796 


The Catalan numbers count many things. For example, the number of permutations 
of {1,...,} that avoid the pattern “123.” 
EXAMPLE ~ Given a product of n terms, the number of ways to pair terms keeping the 


original order is Cn—1. For example, with n = 4, there are C3 = 5 ways to group 4 
terms, they are: (AB)(C'D), ((AB)C)D, (A(BC))D, A((BC)D), and A(B(CD)). 
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3.2.7 PARTITIONS 


A partition of the number n is a representation of n as the sum of positive integral 
parts. The number of partitions of n is denoted p(n). For example: 5 = 4+ 1 = 
34+2=34141=24241=2414141=14141+41+1s0 that p(5) = 7. 


1. The number of partitions of n into exactly m parts is equal to the number 
of partitions of n into parts the largest of which is exactly m; this is denoted 
Pm(n). For example, p2(5) = 2 and p3(5) = 2. Note that )* pm(m) = p(n). 

2. The number of partitions of n into at most m parts is equal to the number of 
partitions of n into parts which do not exceed m. 


Co CoO 1 
3. The partition generating function is 1+ > p(n)a” = (+) 
=o 
n=1 1 


k= 
il 2n 
4. p(n) ~ ins exp | ™4/— | asm — 00 


5 6 7 8 9 10 11 12 13 #14 #«215~~«16 
7 Il 15 22 30 42 56 77 #101 135 176 231 








A table of p,,(n) values. 
The columns sum to p(n). 


1 
2 
3 
4 
2) 
6 
7 
8 
9 





3.2.8 BELL NUMBERS 


The Bell number B,, denotes the number of partitions of a set with n elements. 
For example: the 5 ways to partition the 3-element set {a,b,c} are: {(a), (b), (c)}, 
{(a), (b, c)}, {(d), (a, c)}, {(c), (a, b)}, and {(a, b,c)}. The Bell numbers may be 


written in terms of the Stirling subset numbers: B, = 7) _, {"}. 


[‘H#lt2a4 5 6 7 8 10 


| Be | 1 2 5 15 52 203 877 4140 21147 115975 


1. A generating function for Bell numbers is )>7°_, Bnx” = exp(e* — 1) — 1. 
This gives Dobinski’s formula: By, = e~' pe ie arise 

2. For large values of n, By ~ n~1/?[A(n)|"+1/2eX()—"—1 where A(n) is de- 
fined by the relation: \(n) log A(m) = n; see the Lambert function. 
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3.2.9 STIRLING CYCLE NUMBERS 


The number (7 , called a Stirling cycle number, is the number of permutations of n 
symbols which have exactly / non-empty cycles. These are also called the signed 
Stirling numbers of the first kind. 


EXAMPLE For the 4-element set {a, b, c, d}, there are [3] = 11 permutations containing 
exactly 2 cycles. They are: 








(2r1)- ame, (F734) mm, — (271) - oso. 
(1334) = cus, 8) a - Gi52) = can, 
(1234) — esa os (2143) = 0G. 
(sir2)=09e0, (4591) =4 


3.2.9.1 Properties of Stirling cycle numbers |" 


L |al= ee ae ads 

2. [|= f _ 7 ft] =@-a 
‘fet-omes L2Je() ele 
-fi- sorte oe | 


m=0 
—m—-k 
where " - \ is a Stirling subset number. 
log(1 
8. Sy s(n, bs = (ogee for |x| < 1. Here s(n, k) is a Stirling number 
n=0 : 
of the first kind and can be written as s(n, k) = (—1)"~* [7]. 


9. The factorial polynomial, defined as x(") = x(x — 1)---(« — n +1) with 
a) = 1, can be written as 


=> alr 5( (n, 1)x + s(n, 2)x? .+s(n,n)e” (3.2.4) 
k=0 


For example: 29) = x(a—1)(x—2) = 22-327 +2 = [?]2—[3]2?+[3]23 
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3.2.10 STIRLING SUBSET NUMBERS 


The Stirling subset number, ede is the number of ways to partition n into k blocks. 
Equivalently, it is the number of ways that n distinguishable balls can be placed 
into & indistinguishable cells, with no cell empty. These are also called the Stirling 
numbers of the second kind. 


EXAMPLE Placing the 4 distinguishable balls {a, b,c, d} into 2 indistinguishable cells, 
so that no cell is empty can be done in {3} = 7 ways. These are (vertical bars delineate 
the cells) 


|ab|cd|, |ad|bc|, |ac|bd|, |a| bcd], 
|b] acd|, |clabd|, |d|abc|. 


3.2.10.1 Properties of Stirling subset numbers {7} 


1. Stirling subset numbers are also called Stirling numbers of the second kind, 
and are denoted by S(n, k). 


es Cet 


N 


A 
—S 
wm o3 
Sy 
ll 
bo 
3 
| 
un 
| 
= 
mn 
i Me 
camara 
xr 38 
—— 
=|" 
| 
oO 
8 
=] | 
oe 
> 


n n—-1 n—1 
: =k fork : 
6 it { k exten ork > 0 
k 

n 1 k 

ae a fe. 4 k-—m n 
tee) 

8. Ordinary powers can be expanded in terms of factorial polynomials. If n > 0, 


then 


- "{n y n n nN) (n 
g = othe = 2” 4 {ihe See nh ) (3.2.5) 
For example, 
2 {Seni} phe 
_ f3 3 3 7 3 7 7 (3.2.6) 
= {of + {ihe {3 pote 1)+ . x(a — 1)(x — 2) 


=0+2+3(2? — x) + (2? — 3x? + 22). 
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3.2.11 GENERATING FUNCTIONS 


Generating functions can solve counting problems by clever construction of the gen- 
erating function and appropriate interpretation of its coefficients and the exponents. 

Suppose you have | dime and 2 nickels. For each example below we create an 
appropriate generating function, then interpret the terms. 


1. How many different coin combinations are there? Define 
Gi(x) = las +214) (ec +i? +27") = (2° + 2%) (a + a” + 27") 
pe oe 
either 0 or 1 dime either 0, 1, or 2 nickels 
4 7? ah gn” =i 72” ais et as gitn ai gairan 


99 6s 


We interpret the exponents, sequentually, as: “no coins’, “one nickel’, “two 
nickels’, “a dime’’, ““a dime and a nickel’, “a dime and two nickels”. 
2. How many different combinations of coins can be obtained? Define 
Go(x) = (x°+2') (a9 +2142?) =(14+2)(1+2+27) 
—_— en: 
either 0 or 1 dime either 0, 1, or 2 nickels 


=142r4 2077 + 2° = 17° + 2a! + 22? + 2? 


We interpret the coefficients and exponents, sequentually, as: “1 way to have 0 

coins”, “2 ways to have | coin” (a nickel or a dime), “2 ways to have 2 coins” 

(a nickel and a dime or two nickels), “1 way to have 3 coins” (one dime and 

two nickels), “O ways to have 4 coins”, etc. Note: G2 is G, with {n = d = 1}. 

3. How many different amounts of money can be obtained using these coins? 
Define 

G3(x) = («° +!) (x° 495 +!) = (1 + 1°) (1 seg? + 1°) 
—Sa—ay —-§ 
dimes: 0 or 10 cents nickels: 0,5, or 10 cents 


= Ltr? 4+ 2729 4 oh + 729 = 179 4 7 + 2719 4 gl 4 9720 





We interpret the coefficients and exponents, sequentually, as: “1 way to have 
0 cents” (no coins), “1 ways to have 5 cents” (a nickel), “2 ways to have 10 
cents” (a dime or 2 nickels), “1 way to have 15 cents” (a dime and a nickel), “1 
way to have 20 cents” (a dime and 2 nickels). G2 is G; with {n = 5,d = 10}. 


How many ways are there to convert a dollar into nickels and dimes? Define 
Ga(x) = (x + 09 +07 + 2 4...) (29 ta? ta +04...) 
a 


using any number of dimes using any number of nickels 


(5) (E*)-(enN(cs) 


= 147° 4+ 2719 4+ 27) 4 3079 + 3075 4... 4 11a +... 


So there are 11 different ways to convert a dollar into nickels and dimes. Note: There 
are 121 ways if quarters are also used, 242 ways if pennies and quarters are also used. 
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3.2.12 TABLES 
3.2.12.1_ Combinations C(n,m) = (/") 
These tables contain the number of combinations of n distinct things taken ™m at a 


! 
time, given by C(n,m) = (") Se ( " ) =C(n,n—m). 


m m!(n — m)! n-m 


1 
1 
45 10 1 


165 55 11 
495 220 66 
1287 715 286 
3003 2002 1001 
6435 5005 3003 


12870 | 11440 8008 
24310 | 24310] 19448 


43758 | 48620 | 43758 
75582 | 92378 | 92378 
125970 | 167960 | 184756 


oO 
= 


SCOmAHNTANPWN 
cocoooocooocqc;ococo 
a 


— 
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3.2.12.3 Permutations P(n,m) 


These tables contain the number of permutations of n distinct things taken m at a 


time, given by P(n,m) = n!/(n — m)! = n(n —1)---(n —m+1). 


OoOmDrAINMN BWN eR 


eRe eee 
kRWNrF CO 


— 
SCOMAAYNNMN HWY KR 


79833600 
259459200 
726485760 

1816214400 


CO ANDUN FPwWNKE 


eRe eee 
RWNrF CO 


ee 
nN 


362880 
3628800 
19958400 


3628800 
39916800 
239500800 
1037836800 
3632428800 
10897286400 


274 
1764 
13068 
109584 
1026576 


720 
5040 
40320 
362880 


ooooocooco 


120 
720 
2520 
6720 
15120 


30240 
55440 
95040 
154440 
240240 


360360 


720 
5040 
20160 
60480 


151200 
332640 
665280 
1235520 
2162160 


3603600 


39916800 
479001600 
3113510400 6 


14529715200 
54486432000 


35 

225 
1624 
13132 
118124 
1172700 


43 
217 


10 
85 
735 
6769 


67284 
723680 


5040 
40320 
181440 


604800 
1663200 
3991680 
8648640 

17297280 


32432400 


479001600 
227020800 
589145600 
945728000 


1 

15 

175 
1960 
22449 
269325 


40320 
362880 


1814400 
6652800 
19958400 
51891840 
121080960 


259459200 


6227020800 
87178291200 
653837184000 
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3.3. GRAPHS 


3.3.1. NOTATION 


3.3.1.1. Notation for graphs 


FE edge set V_ vertex set 
G graph @ incidence mapping 


3.3.1.2 Graph invariants 


Aut(G) automorphism group c(G) circumference 

d(u,v) distance between two vertices diam(G) diameter 

deg x degree of a vertex e(G) size 

ecc(x) eccentricity gir(G) girth 

rad(G) radius Pg(«) chromatic polynomial 
Z(G) center a(G) independence number 
x(G) chromatic number x/(G) chromatic index 

5(G) minimum degree A(G) maximum degree 
7(G) genus 4(G) crosscap number 
K(G) vertex connectivity (G) edge connectivity 
v(G) crossing number D(G) rectilinear crossing number 
0(G) thickness T(G) arboricity 

w(G) clique number |G| order 


3.3.1.3 Examples of graphs 


Cn cycle On odd graph 
Kn empty graph P, path 

Kn complete graph 0; Gube 

Kmin complete bipartite graph Sa star 

nO Kneser graphs Trike Turan graph 
Mn, Mobius ladder Wr wheel 


3.3.2 BASIC DEFINITIONS 


There are two standard definitions of graphs, a general definition and a more com- 
mon simplification. Except where otherwise indicated, this book uses the simplified 
definition, according to which a graph is an ordered pair (V, F) consisting of an ar- 
bitrary set V and a set EF of 2-element subsets of V. Each element of V is called a 
vertex (plural vertices). Each element of F is called an edge. 
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According to the general definition, a graph is an ordered triple G = (V, E, ¢) 
consisting of arbitrary sets V and F and an incidence mapping ¢ that assigns to each 
element e € EF a non-empty set ¢(e) C V of cardinality at most two. Again, the 
elements of V are called vertices and the elements of EF are called edges. A loop is 
an edge e for which |¢(e)| = 1. A graph has multiple edges if edges e # e’ exist for 
which ¢(e) = @(e’). 

A (general) graph is simple if it has neither loops nor multiple edges. Because 
each edge in a simple graph can be identified with the two-element set ¢(e) C V, 
the simplified definition of graph given above is an alternative definition of a simple 
graph. 

The word multigraph is used to discuss general graphs with multiple edges but 
no loops. Occasionally the word pseudograph is used to emphasize that the graphs 
under discussion may have both loops and multiple edges. Every graph G = (V, E) 
considered here is finite, i.e., both V and £ are finite sets. 

Specialized graph terms include the following: 


acyclic: A graph is acyclic if it has no cycles. 

adjacency: Two distinct vertices v and w in a graph are adjacent if the pair {v, w} 
is an edge. Two distinct edges are adjacent if their intersection is non-empty, 
i.e., if there is a vertex incident with both of them. 

adjacency matrix: For an ordering v1, v2,..., Un of the vertices of a graph G = 
(V, E) of order |G| = n, there is a corresponding n x n adjacency matrix A = 
(ai) defined as follows: 


os 1 if{u,vj;} € EB; (3.3.1) 
‘ Q otherwise. ~ 


arboricity: The arboricity Y(G) of a graph G is the minimum number of edge- 
disjoint spanning forests into which G' can be partitioned. 

automorphism: An automorphism of a graph is a permutation of its vertices that 
is an isomorphism. 

automorphism group: The composition of two automorphisms is again an auto- 
morphism; with this binary operation, the automorphisms of a graph G form a 
group Aut(G) called the automorphism group of G. 

ball: The ball of radius k about a vertex u in a graph is the set 


Biu,k) = {ve V | d(u,v) < k}. (3.3.2) 


See also sphere and neighborhood. 

block: A block is a graph with no cut vertex. A block of a graph is a maximal 
subgraph that is a block. 

bridge: A bridge is an edge in a connected graph whose removal would disconnect 
the graph. 

cactus: A cactus is a connected graph, each of whose blocks is a cycle. 

cage: An (r,n)-cage is a graph of minimal order among r-regular graphs with 
girth n. A (3, )-cage is also called an n-cage. 
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center: The center Z(G) of a graph G = (V, FE) consists of all vertices whose 
eccentricity equals the radius of G: Z(G’) = {v € V(G) | ecc(v) = rad(G)}. 
Each vertex in the center of G is called a central vertex. 

characteristic polynomial: All adjacency matrices of a graph G have the same 
characteristic polynomial, which is called the characteristic polynomial of G. 

chromatic index: The chromatic index y'(G) is the least k for which there exists 
a proper k-coloring of the edges of G; in other words, it is the least number of 
matchings into which the edge set can be decomposed. 

chromatic number: The chromatic number x(G) of a graph G is the least k for 
which there exists a proper k-coloring of the vertices of G; in other words, it 
is the least k for which G is k-partite. See also multipartite. 

chromatic polynomial: For a graph G of order |G| = n with exactly k connected 
components, the chromatic polynomial of G' is the unique polynomial Pg (x) 
for which Pg(m) is the number of proper colorings of G with m colors for 
each positive integer m. 

circuit: A circuit in a graph is a trail whose first and last vertices are identical. 

circulant graph: A graph G is a circulant graph if its adjacency matrix is a circu- 
lant matrix; that is, the rows are circular shifts of one another. 

circumference: The circumference of a graph is the length of its longest cycle. 

clique: A clique is a set S of vertices for which the induced subgraph G[.S] is 
complete. 

clique number: The clique number w(G) of a graph G is the largest cardinality of 
a clique in G. 

coloring: A partition of the vertex set of a graph is called a coloring, and the 
blocks of the partition are called color classes. A coloring with k color classes 
is called a k-coloring. A coloring is proper if no two adjacent vertices belong 
to the same color class. See also chromatic number and chromatic polynomial. 

complement: The complement G of a graph G = (V,E) has vertex set V and 
edge set (S) \ E; that is, its edges are exactly the pairs of vertices that are not 
edges of G. 

complete graph: A graph is complete if every pair of distinct vertices is an edge; 
XK, denotes a complete graph with n vertices. 

component: A component of a graph is a maximal connected subgraph. 

connectedness: A graph is said to be connected if each pair of vertices is joined by 
a walk; otherwise, the graph is disconnected. A graph is k-connected if it has 
order at least & + 1 and each pair of vertices is joined by k pairwise internally 
disjoint paths. If a graph is disconnected, then its complement is connected. 

connectivity: The connectivity k(G) of G is the largest k for which G is k- 
connected. 

contraction: To contract an edge {v, w} of a graph G is to construct a new graph 
G’ from G by removing the edge {v, w} and identifying the vertices v and w. 
A graph G is contractible to a graph H if H can be obtained from G via the 
contraction of one or more edges of G. 

cover: A set S C V is a vertex cover if every edge of G is incident with some 
vertex in S. A set TC E is an edge cover of a graph G = (V, E) if each 
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vertex of G is incident to at least one edge in T. 

crosscap number: The crosscap number ¥(G) of a graph G is the least g for which 
G has an embedding in a non-orientable surface obtained from the sphere by 
adding g crosscaps. See also genus. 

crossing: A crossing is a point lying in images of two edges of a drawing of a 
graph on a surface. 

crossing number: The crossing number v(G) of a graph G is the minimum num- 
ber of crossings among all drawings of G in the plane. The rectilinear cross- 
ing number U(G) of a graph G is the minimum number of crossings among all 
drawings of G' in the plane for which the image of each edge is a straight line 
segment. 

cubic: A graph is a cubic graph if it is regular of degree 3. 

cut: For each partition of the vertex V set of a graph G = (V, EF) into two disjoint 
blocks (V; and V3), the set of all edges joining a vertex in V; to a vertex in V2 
is called a cut. 

cut space: The cut space of a graph G is the subspace of the edge space of G 
spanned by the cut vectors. 

cut vector: The cut vector corresponding to a cut C of a graph G = (V, E) is the 
mapping v: E — GF‘(2) in the edge space of G 


1, e€C 
=< 0 : 53355 
ue) {0 otherwise. ( ) 


cut vertex: A cut vertex of a connected graph is a vertex whose removal, along 
with all edges incident with it, leaves a disconnected graph. 

cycle: A cycle is a circuit, each pair of whose vertices other than the first and the 
last are distinct. 

cycle space: The cycle space of a graph G is the subspace of the edge space of G 
consisting of all 1-chains with boundary 0. An indicator mapping of a set of 
edges with which each vertex is incident an even number of times is called a 
cycle vector. The cycle space is the span of the cycle vectors. 

degree: The degree deg x of a vertex x in a graph is the number of vertices adja- 
cent to it. The maximum and minimum degrees of vertices in a graph G' are 
denoted A(G) and 6(G), respectively. 


degree sequence: A sequence (d1,...,d,,) is a degree sequence of a graph if there 
is some ordering v1,...,Un of the vertices for which d; is the degree of vu; for 
each 2. 


diameter: The diameter of G is the maximum distance between two vertices of G; 
thus it is also the maximum eccentricity of a vertex in G. 

digraph: A digraph is a directed graph in which each edge has a direction. 

distance: The distance d(u,v) between vertices u and v in a graph G is the mini- 
mum among the lengths of u, v-paths in G, or oo if there is no u, v-path. 

drawing: A drawing of a graph G ina surface S consists of a one-to-one mapping 
from the vertices of G to points of S' and a one-to-one mapping from the edges 
of G to open arcs in X so that (i) no image of an edge contains an image of 
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some vertex, (ii) the image of each edge {v, w} joins the images of v and w, 
(iii) the images of adjacent edges are disjoint, (iv) the images of two distinct 
edges never have more than one point in common, and (v) no point of the 
surface lies in the images of more than two edges. 

eccentricity: The eccentricity ecc(x) of a vertex x in a graph G is the maximum 
distance from x to a vertex of G. 

edge connectivity: The edge connectivity or line connectivity of G, denoted X(G), 
is the minimum number of edges whose removal results in a disconnected or 
trivial graph. 

edge space: The edge space of a graph G = (V, £) is the vector space of all 
mappings from E£ to the two-element field GF'(2). Elements of the edge space 
are called 1-chains. 

embedding: An embedding of a graph G in a topological space X consists of an 
assignment of the vertices of G to distinct points of X and an assignment of 
the edges of G to disjoint open arcs in X so that no arc representing an edge 
contains some point representing a vertex and so that each arc representing an 
edge joins the points representing the vertices incident with the edge. See also 
drawing. 

end vertex: A vertex of degree 1 in a graph is called an end vertex. 

Eulerian circuits and trails: A trail or circuit that includes every edge of a graph 
is said to be Eulerian, and a graph is Eulerian if it has an Eulerian circuit. 

even: A graph is even if the degree of every vertex is even. 

factor of a graph: A factor of a graph G is a spanning subgraph of G. A factor in 
which every vertex has the same degree k is called a k-factor. If Gi, Go, ..., 
Gy (k > 2) are edge-disjoint factors of the graph G,, and if a E(G;) = 
E(G), then G is said to be factored into G1, Gz, ..., Gz and we write G = 
G, BG2O-:-OGx. 

forest: A forest is an acyclic simple graph; see also tree. 

genus: The genus 7(G) (plural form genera) of a graph G is the least g for which 
G has an embedding in an orientable surface of genus g. See also crosscap 
number. 

girth: The girth gir(G) of a graph G is the minimum length of a cycle in G, or co 
if G' is acyclic. 

Hamiltonian cycles and paths: A path or cycle through all the vertices of a graph 
is said to be Hamiltonian. A graph is Hamiltonian if it has a Hamiltonian 
cycle. 

homeomorphic graphs: Two graphs are homeomorphic to one another if there is 
a third graph of which each is a subdivision. 

identification of vertices: To identify vertices v and w of a graph G is to construct 
a new graph G’ from G by removing the vertices v and w and all the edges 
of G incident with them and introducing a new vertex u and new edges joining 
u to each vertex that was adjacent to v or to w in G. See also contraction. 

incidence: A vertex v and an edge e are incident with one another if v € e. 
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FIGURE 3.2 


Three graphs that are isomorphic. 


Ul BA 


incidence matrix: For an ordering v1, v2,..., Un of the vertices and an ordering 
€1,€2,--+,;€m Of the edges of a graph G = (V, E) with order |G| = n and 
size e(G) = m, there is a corresponding n x m incidence matrix B = (b;;) 
defined as follows: 














—_ {0 if v; and e; are incident, (3.3.4) 


0, otherwise. 


independence number: The independence number a(G) of a graph G = (V, E) 
is the largest cardinality of an independent subset of V. 

independent set: A set S C V is said to be independent if the induced sub- 
graph G[S] is empty. See also matching. 

internally disjoint paths: Two paths in a graph with the same initial vertex v 
and terminal vertex w are internally disjoint if they have no internal vertex in 


common. 
isolated vertex: A vertex is isolated if it is adjacent to no other vertex. 
isomorphism: An isomorphism between graphs G = (Vc,Eq) and H = 


(Vi, Ex) is a bijective mapping q): Vo — Vy for which {x,y} € Eg if and 
only if {v(x),v(y)} © Ey. If there is an isomorphism between G and H, 
then G and H are said to be isomorphic to one another; this is denoted as 
G = H. Figure 3.2 contains three graphs that are isomorphic. 

labeled graph: Graph theorists sometimes speak loosely of labeled graphs of 
order n and unlabeled graphs of order n to distinguish between graphs with 
a fixed vertex set of cardinality n and the family of isomorphism classes of 
such graphs. Thus, one may refer to /abeled graphs to indicate an intention to 
distinguish between any two graphs that are distinct (i.e., have different vertex 
sets and/or different edge sets). One may refer to unlabeled graphs to indicate 
the intention to view any two distinct but isomorphic graphs as the ‘same’ 
graph, and to distinguish only between non-isomorphic graphs. 

matching: A matching in a graph is a set of edges, no two having a vertex in 
common. A maximal matching is a matching that is not a proper subset of any 
other matching. A maximum matching is a matching of greatest cardinality. 
For a matching M, an M-alternating path is a path whose every other edge 
belongs to M, and an M-augmenting path is an M-alternating path whose first 
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and last edges do not belong to 7. A matching saturates a vertex if the vertex 
belongs to some edge of the matching. 

monotone graph property: A property P that a graph may or may not enjoy is 
said to be monotone if, whenever H is a graph enjoying P, every supergraph G 
of H with |G| = |A| also enjoys P. 

multipartite graph: A graph is k-partite if its vertex set can be partitioned into 
k; disjoint sets called color classes in such a way that every edge joins vertices 
in two different color classes (see also coloring). A two-partite graph is called 
bipartite. 

neighbor: Adjacent vertices v and w in a graph are said to be neighbors of one 
another. 

neighborhood: The sphere S(x,1) is called the neighborhood of x, and the 
ball B(, 1) is called the closed neighborhood of «x. 

order: The order |G| of a graph G = (V, E£) is the number of vertices in G; in 
other words, |G| = |V]. 

path: A path is a walk whose vertices are distinct. 

perfect graph: A graph is perfect if x(H) = w(#) for all induced subgraphs H 
of G. 

planarity: A graph is planar if it has an embedding in the plane. 

radius: The radius rad(G) of a graph G is the minimum vertex eccentricity in G. 

regularity: A graph is k-regular if each of its vertices has degree hk. A graph is 
strongly regular with parameters (k, A, j1) if (i) it is k-regular, (ii) every pair of 
adjacent vertices has exactly \ common neighbors, and (iii) every pair of non- 
adjacent vertices has exactly 4. common neighbors. A graph G = (V, E) of 
order |G| > 3 is called highly regular if there exists ann x n matrix C = (ci;), 
where 2 < n < |G|, called a collapsed adjacency matrix, so that, for each 
vertex v of G,, there is a partition of V into n subsets V; = {vu}, Vo,..., Vn so 
that every vertex y € Vj; is adjacent to exactly c;; vertices in V;. Every highly 
regular graph is regular. 

rooted graph: A rooted graph is an ordered pair (G, v) consisting of a graph G’ 
and a distinguished vertex v of G called the root. 

self-complementary: A graph is self-complementary if it is isomorphic to its com- 
plement. 

similarity: Two vertices u and v of a graph G are similar (in symbols u ~ v) if 
there is an automorphism a of G for which a(u) = v. Similarly, two edges 
(u, v) and (a,b) in the graph G are similar if an automorphism a of G exists 
for which {a(u), a(v)} = {a, b}. 

size: The size e(G) of a graph G = (V, £) is the number of edges of G, that is, 
e(G) = |E|. 

spectrum: The spectrum of a graph G is the spectrum of its characteristic polyno- 
mial, i.e., the non-decreasing sequence of |G| eigenvalues of the characteristic 
polynomial of G. Since adjacency matrices are real symmetric, their spectrum 
is real. 
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sphere: The sphere of radius k about a vertex wu is the set 
S(u,k) = {ve V | d(u,v) =k}. (3.3.5) 


See also ball and neighborhood. 

subdivision: To subdivide an edge {v, w} of a graph G is to construct a new graph 
G’ from G by removing the edge {v, w} and introducing new vertices x; and 
new edges {v, x1}, {ax, w} and {2;, 7:41} for 1 <i < k. A subdivision of a 
graph is a graph obtained by subdividing one or more edges of the graph. 

subgraph: A graph H = (Vy, Ey) is a subgraph of a graph G = (Va, Ec) (in 
symbols, H = G), if Vy C Ve and Ey C Eg. In that case, G is a supergraph 
of H (insymbols, G = H). If Va = Va, then H is called a spanning subgraph 
of G. For each set S' C Va, the subgraph G[S] of G induced by S is the unique 
subgraph of G' with vertex set S for which every edge of G incident with two 
vertices in S' is also an edge of G[S]. 

symmetry: A graph is vertex symmetric if every pair of vertices is similar. A graph 
is edge symmetric if every pair of edges is similar. A graph is symmetric if it 
is both vertex and edge symmetric. 

2-switch: For vertices v,w,x,y in a graph G for which {v,w} and {x,y} are 
edges, but {v, y} and {x, w} are not edges, the construction of a new graph G” 
from G via the removal of edges {v, w} and {, y} together with the insertion 
of the edges {v, y} and {x, w} is called a 2-switch. 

thickness: The thickness 0(G) of a graph G is the least & for which G is a union 
of k planar graphs. 

trail: A trail in a graph is a walk whose edges are distinct. 

tree: A tree is a connected forest, i.e., a connected acyclic graph. A spanning 
subgraph of a graph G that is a tree is called a spanning tree of G. 

triangle: A 3-cycle is called a triangle. 

trivial graph: A trivial graph is a graph with exactly one vertex and no edges. 

vertex space: The vertex space of a graph G is the vector space of all mappings 
from V to the two-element field GF'(2). The elements of the vertex space are 
called 0-chains. 

walk: A walk in a graph is an alternating sequence vo, €1,V1,...,€k, Uk Of ver- 
tices v; and edges e; for which e; is incident with v;_; and with v; for each 7. 
Such a walk is said to have length k and to join vo and v;. The vertices vo 
and vu; are called the initial vertex and terminal vertex of the walk; the remain- 
ing vertices are called internal vertices of the walk. 
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3.3.3. CONSTRUCTIONS 


3.3.3.1. Operations on graphs 


For graphs G, = (Vi, £,) and G2 = (V2, E2), there are several binary operations 
that yield a new graph from G‘; and G2. The table below gives the names of some of 
those operations and the orders and sizes of the resulting graphs. 


Operation producing G Order |G Size e(G) 
Composition G [Go] |G1| e(G2) + |G@a| e(G1) 
Conjunction GA G2 


Edgesum¢ G,@®G2 (e(G1) + e(G2)) 

Join Gy — Go e(G1) ai e(G2) + |Gi| z |Go| 
Product G, x Gg] = . |GyJe(G2) + |G2|e(Gi) 
Union G, UG» = e(Gi) + e(G2) 

















“When applicable. 


composition: For graphs Gy = (V1, £1) and Gy = (V2, E2), the composition 
G = G[G9] is the graph with vertex set V; x V2 whose edges are (1) the pairs 
{(u,v), (u, w)} with wu € Vi and {v, w} © E and (2) the pairs {(t, u), (v, w)} 
for which {t,v} € E4. 

conjunction: The conjunction G; \ G2 of two graphs Gy; = (Vi, £1) and Gp = 
(V2, E2) is the graph G3 = (V3, 3) for which V3 = V; x V2 and for which 
vertices ey = (ui, U2) and eg = (v1, v2) in V3 are adjacent in Gs if and only 
if uy is adjacent to v; in G; and ug is adjacent to v2 in G2. 

edge difference: For graphs G, = (V, £1) and Gz = (V, £2) with the same vertex 
set V, the edge difference G1 — G2 is the graph with vertex set V and edge set 
BX By, 

edge sum: For graphs G; = (V,£,) and Gz = (V, £2) with the same vertex 
set V, the edge sum of G'; and G2 is the graph G'; © G2 with vertex set V and 
edge set EF U £2. Sometimes the edge sum is denoted G, U Go. 

join: For graphs G, = (Vi, £1) and Gg = (Vo, Ea) with Vi N V2 = 9, the join 
G1 + Gg = G2 + G; Is the graph obtained from the union of G, and G2 by 
adding edges joining each vertex in V; to each vertex in V2. 

power: Fora graph G = (V,£E), the k power G* is the graph with the same 
vertex set V whose edges are the pairs {u,v} for which d(u,v) < kin G. The 
square of G is G?. 

product: For graphs G; = (Vi, £) and G2 = (V2, £2), the product G x G2 has 
vertex set Vi x Vo; its edges are all of the pairs {(u,v), (u, w)} for which u € 
V, and {v, w} © Ez and all of the pairs {(¢, v), (u, v)} for which {t,u} € Ey 
and v € Vo. 

union: For graphs G; = (Vi, £1) and Gg = (Vo, E2) with Vi N Vo = 9, the 
union of G, and G2 is the graph G; U G2 = (Vi U Va, Ey U Ea). The union 
is sometimes called the disjoint union to distinguish it from the edge sum. 
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3.3.3.2 Graphs described by one parameter 


complete graph, K,,: A complete graph of order n is a graph isomorphic to the 
graph K,,, with vertex set {1,2,...,} whose every pair of vertices is an edge. 
The graph K,, has size ie and is Hamiltonian. If G is a graph g of order n, 
then K, =GOG. 

cube, Q,,: An n-cube is a graph isomorphic to the graph Q,, whose vertices are 
the 2” binary n-vectors and whose edges are the pairs of vectors that differ in 
exactly one place. It is an n-regular bipartite graph of order 2” and size n2”~1. 
An equivalent recursive definition is Q; = K2 and Q, = Qn_1 X Ko. 

cycle, C;,: A cycle of order n is a graph isomorphic to the graph C;, with vertex 
set {0,1,...,— 1} whose edges are the pairs {v;, v;41} with 0 < i < nand 
arithmetic modulo n. The cycle C,, has size n and is Hamiltonian. 

The graph C’, is a special case of a circulant graph. The graph C3 is called a 
triangle, the graph C4 is called a square. 

empty graph: A graph is empty if it has no edges; K,, denotes an empty graph of 
order 7. 

Kneser graphs, K{""): For n > 2m, the Kneser graph K&” is the complement 
of the intersection graph of the m-subsets of an n-set. The odd graph Oy, is 
the Kneser graph K. ae The Petersen graph is the odd graph O2 = ©), 

ladder: A ladder is a graph of the form P,, x Pz. The Mobius ladder M,, is the 
graph obtained from the ladder P,, x P 2 by joining the opposite end vertices 
of the two copies of P,,. 

path, P,,: A path of order n is a graph isomorphic to the graph P,, whose vertex 
set is {1,...,} and whose edges are the pairs {v;,v:41} with 1 <i<n.A 
path of order n has size n — 1 and is a tree. 

star, S,,: A star of order n is a graph isomorphic to the graph S,, = Ky,». It has 
a vertex cover consisting of a single vertex, its size is n, and it is a complete 
bipartite graph and a tree. 

wheel, W,,: The wheel W,, of order n > 4 consists of a cycle of order n — 1 
and an additional vertex adjacent to every vertex in the cycle. Equivalently, 
Wr = Cn-1 + K4. This graph has size 2(n — 1). 

3.3.3.3 Graphs described by two parameters 


complete bipartite graph, K,,,,:| The complete bipartite graph K,,,, is the 
graph K, + Ky. Its vertex set can be partitioned into two color classes of 
cardinalities n and m, respectively, so that each vertex in one color class is ad- 
jacent to every vertex in the other color class. The graph Kym has ordern+m 
and size nm. 

planar mesh: A graph of the form P, x Pm is called a planar mesh. 

prism: A graph of the form C;,, x P,, is called a prism. 

toroidal mesh: A graph of the form C,,, x C,, with m > 2 and n > 2. 

Turan graph, T;,,: The Turdn graph T,,, is the complete k-partite graph in 
which the cardinalities of any two color classes differ by, at most, one. It has 
n—k|n/k] color classes of cardinality |[n/k| +1 andk —n+k|n/k| color 
classes of cardinality |n/k|. Note that w(Ty,,,) = k. 
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FIGURE 3.3 
Examples of graphs with 6 or 7 vertices. 


Kg= P= 


Se = W7 = 


Ce = K33 = 








SEO 


3.3.3.4 Graphs described by three or more parameters 
Cayley graph: For a group [ and a set X of generators of I’, the Cayley graph 


of the pair (I', X) is the graph with vertex set I in which {a, 3} is an edge if 
eithera~'B8€ X or Blac X. 


complete multipartite graph, Ky, 7. ,....n,: The complete k-partite graph 
Kn ino,....n, 18 the graph K,,, + +--+ Kn,. Itis a k-partite graph with color 
classes V; of cardinalities |V;| = n; for which every pair of vertices in two 


distinct color classes is an edge. The graph Ky, n5,....n, has order > Nk 
and size <jcjcp MiNj: 

intersection graph: For a family F = {5},...,5,,} of subsets of a set S, the 
intersection graph of F is the graph with vertex set F' in which {S;, 5} is an 
edge if and only if S;.S; 4 0. Each graph G is an intersection graph of some 
family of subsets of a set of cardinality at most ||G|?/4|. 

interval graph: An interval graph is an intersection graph of a family of intervals 
on the real line. 
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3.3.4 FUNDAMENTAL RESULTS 
3.3.4.1. Walks and connectivity 


ANN 


10. 


. Every x, y walk includes all the edges of some z, y path. 
. Some path in G has length 6(G). 
. Connectivity is a monotone graph property. If more edges are added to a 


connected graph, the new graph is itself connected. 


. A graph is disconnected if and only if it is the union of two graphs. 

. Every vertex of a graph lies in at least one block. 

. For every graph G, 0 < K(G) < |G|—1. 

. For all integers a, b, c with 0 < a < b < c,a graph G exists with K(G) = a, 


A(G) = b, and 6(G) = c. 


. For any graph G, K(G) < A(G) < 6(G). 
. Menger’s theorem: Suppose that G is a connected graph of order greater 


than k. Then G is k-connected if and only if it is impossible to disconnect G 
by removing fewer than /; vertices, and G' is k-edge connected if and only if it 
is impossible to disconnect G' by removing fewer than k edges. 

If G is a connected graph with a bridge, then \(G’) = 1. If G has order n and 
is r-regular with r > n/2, then A(G) = r. 


3.3.4.2 Circuits and cycles 


I, 


Euler’s theorem: A multigraph is Eulerian if and only if it is connected and 
even. 


. If Gis Hamiltonian, and if G’ is obtained from G by removing a non-empty 


set S of vertices, then the number of components of G” is at most |S]. 


. Ore’s theorem: If G is a graph for which deg v + degw > |G| whenever v 


and w are non-adjacent vertices, then G is Hamiltonian. 


. Dirac’s theorem: If G is a graph of order |G| > 3 and deg v > |G|/2 for each 


vertex vu, then G is Hamiltonian. 


. (Erdés—Chvatal) If a(G) < «(G), then G is Hamiltonian. 
. Every 4-connected planar graph is Hamiltonian. 


. The following table indicates which graphs are Eulerian or Hamiltonian: 


yes yes, forn > 1 
yes, for odd n yes, forn > 3 


yes, form and n both even yes, form =n 
yes, for n even yes, for n > 2 
no yes, for n > 2 
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3.3.4.3 Trees 


1. 


NANNKWN 


. Nash—Williams arboricity theorem: For a graph G and for each n < 


A graph is a tree if and only if 
(a) itis acyclic and has size |G| — 1. 
(b) it is connected and has size |G| — 1. 
(c) each of its edges is a bridge. 
(d) each vertex of degree greater than 1 is a cut vertex. 
(e) each pair of its vertices is joined by exactly one path. 


. Every connected graph has a spanning tree. 

. Every tree of order greater than 1 has at least two end vertices. 

. The center of a tree consists of one vertex or two adjacent vertices. 

. For a graph G, every tree with at most 6(G) edges is a subgraph of G. 

. Kirchhoff matrix-tree theorem: Let G be a connected graph and let A be an ad- 


jacency matrix for G. Obtain a matrix MM from —A by replacing each term aj; 
on the main diagonal with degv;. Then all cofactors of MW have the same 
value, which is the number of spanning trees of G. 





IG 
define e,(G) = max{e(H) : H x G, and|H| = n}. Then Y(G) = 
max fen/(n—1)]. 


3.3.4.4 Cliques and independent sets 


ie 
2. 
3 


A set S C V is a vertex cover if and only if V \ S is an independent set. 
Turdn’s theorem: If |G| =n and w(G) < k, then e(G) < e(Tn,x). 

Ramsey’s theorem: For all positive integers k and J, there is a least inte- 
ger R(k,1) for which every graph of order at least R(k,1) has either a clique 
of cardinality & or an independent set of cardinality 1. For k > 2 and / > 2, 
R(k, 1) < R(k,l— = —— 1,1). 


pest [ts Tat st oy 7 


= | ih 
1 
1 a i: ‘5 





3.3.4.5 Colorings and partitions 


BRWNFe 


. Pa(a) = Pe-e(x) — Pe\e(2). 

. (Appel—Haken) Four-color theorem: x(G) < 4 for every planar graph G. 

. (Konig) If G is bipartite, then y/(G) = A(G). 

. Brooks’ theorem: If G is a connected graph that is neither a complete graph 


nor a cycle of odd length, then y(G) < A(G). 


. Szekeres—Wilf theorem: For every graph G = (V, E), 


XG) = 1 mao Gls |): 


. Vizing’s theorem: For every graph G, A(G) < y’/(G) < A(G) +1 
. Every graph G is k-partite for some k; in particular, G is |G|-partite. 
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. Every graph G has a bipartite subgraph H for which e(H) > e(G)/2. 
. For all positive integers g and c, a graph G exists such that y(G) > c and 


gir(G) > g. 
Nordhaus—Gaddum bounds: For every graph G, 


2//G| < x(@) + x(G) < |G|+1, and 


eet) 


ais xa@n@) < (4 


The following table gives the chromatic numbers and chromatic polynomials 
of various graphs: 


x(x —1)"-1 
x(x —1)"-1 
x(a — 1)(@? — 34 +3) 
The following table gives the chromatic numbers and edge-chromatic numbers 
(i.e., edges are colored instead of vertices) of various graphs: 
MA] 1G) 
C,, with n even, n > 2 
Cy, with n odd, n > 3 
Ky with n even, n > 2 
Ky, with n odd, n > 3 
Km with m,n > 1 
m, With m; > 1 





n—-1 
n 
max(m, n) 
max(m,..., 7M) 
2 
Petersen graph 
W,, with n even, n > 2 
W,, with n odd, n > 3 
For each graph G of order |G| = n and size e(G') = m with exactly k compo- 
nents, the chromatic polynomial is of the form 





2 
3 
n 
n 
2 
k 
2 
3 
3 
4 


4 
n 
n 


Po(2) = So (-lfaa”™, (3.3.6) 


with ag = 1, a1 = mand every a; positive. 

Not every polynomial is a chromatic polynomial. For example P(x) = x* — 
4a? + 32? is not a chromatic polynomial. 

Sometimes a class of chromatic polynomials can only come from a specific 
class of graphs. For example: 


(a) If Po(x) = x”, thenG = Kp. 
(b) If Pe (x) = ()n, then G = Ky. 
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3.3.4.6 Distance 


1. 


2. 


3. 


A metric space (X,d) is the metric space associated with a connected graph 
with vertex set X if and only if it satisfies two conditions: (i) d(u, v) is a non- 
negative integer for all u, v € X, and (ii) whenever d(u, v) > 2, some element 
of X lies between u and v. The edges of the graph are the pairs {u,v} C X 
for which d(u,v) = 1. (In an arbitrary metric space (X,d), a point v € X is 
said to lie between distinct points u € X and w € X if it satisfies the triangle 
equality d(u, w) = d(u,v) + d(v, w).) 

If G = (V,£) is connected, then distance is always finite, and d is a metric 
on V. Note that deg(x) = |S(a, 1)]. 

Moore bound: For every connected graph G, 


diam(G) 
IG) <1+ AG) S> (A(@)-1). (3.3.7) 
i=1 

A graph for which the Moore bound holds exactly is called a Moore graph 
with parameters (|G|, A(G), diam(G)). Every Moore graph is regular. If G 
is a Moore graph with parameters (n,1r,d), then (n,r,d) = (n,n — 1,1) (in 
which case G is complete), (n,r,d) = (2m + 1,2,m) (in which case G is a 
(2m + 1)-cycle), or (n,r, d) € {(10, 3, 2), (50, 7, 2), (3250, 57, 2)}. 





3.3.4.7 Drawings, embeddings, planarity, and thickness 


1. 


Every graph has an embedding in R® for which the arcs representing edges 
are all straight line segments. Such an embedding can be constructed by using 
distinct points on the curve {(t,¢?,t?) : 0 < t < 1} as representatives for the 
vertices. 


. Every planar graph can be embedded in the plane so that every edge is a 


straight line segment; this is a Fary embedding. 


. Forn > 2, 


(Qn) =(n— 42" 41 and H(Qu) = (n— 4)2"-? +2. 


md UK) =| 


. Forn > 3, 


(Kn) = and (Kn) = 


. Heawood map coloring theorem: The greatest chromatic number among 


graphs of genus n is 


max{(G) |G) =n} = |) 
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. Kuratowski’s theorem: A graph is planar if and only if it has no subgraph 


homeomorphic to A’s or K’3.3. 


. A graph is planar if and only if it does not have a subgraph contractible to K5 


or K33. 


. The graph /,, is non-planar if and only if n > 5. 
. The four-color theorem states that any planar graph is four colorable. 


. For every graph G of order |G'| > 3, 0(G) > 
. The complete graphs 9 and Ky have thickness 3; re n ¢ {9,10}, 


ss 
3G) —6 





6(Kn) = (3.3.8) 


n+ ‘| 
The n-cube has thickness 0(Q,,) = |n/4| + 1. 
For every planar graph G, v(G) = 7(G). That equality does not hold for all 
graphs: v(i«g) = 18, and V(Kg) = 19. 


3.3.4.8 Vertex degrees 


1. 
. Every 2-switch preserves the degree sequence. 
. If G and H have the same degree sequence, then H can be obtained from G 


Handshaking lemma: For every graph G, )),cy deg vu = 2e(G). 


via a sequence of 2-switches. 


. Havel-Hakimi theorem: The values {d1, d2,...,d,} with dy > dz >--- > 


dy, > 0 are a degree sequence if and only if the sequence obtained by deleting 
d, and subtracting 1 from each of the next d, largest values (ie., {dz — 1, 
d3 —1,..., da,41 — 1, da,+2, ..-, dn}) is a degree sequence. 


. Erdos—Gallai theorem: The values {d,,d2,...,d,} are a degree sequence if 


and only if the sum of vertex ceerress is even ‘ind the SCARE has the property, 


for each integer r < n— 1: s dy <r(r—-1)+ % min(r, d;). 
j= i=rt+1 


3.3.4.9 Algebraic methods 


1; 


The bipartite graphs K,,,,, are circulant graphs. 


2. For a graph G' with exactly & connected components, the cycle space has di- 


mension e(G) — |G| + k, and the cut space has dimension |G| — 


. In the k™ power A* = (ak,) of the adjacency matrix, each entry ak. is the 


number of v;, v; walks of length k. 


. The incidence matrix of a graph G is totally unimodular if and only if G is 


bipartite. (Unimodular matrices form a group under matrix multiplication.) 


. The smallest graph that is vertex symmetric, but is not edge symmetric, is the 


prism K3 x Ke. The smallest graph that is edge symmetric, but is not vertex 
symmetric, is Sy = P3 = Ky 2. 


. The spectrum of a disconnected graph is the union of the spectra of its compo- 


nents. 


. The sum of the eigenvalues in the spectrum of a graph is zero. 


12. 


13. 


14. 
iD: 


16. 


17. 
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. The number of distinct eigenvalues in the spectrum of a connected graph is 


greater than the diameter of the graph. 


. The largest eigenvalue in the spectrum of a graph G is, at most, A(G), with 


equality if and only if G is regular. 


. (Hoffman) If G is a connected graph of order n with spectrum Ay > --- > An, 


then x(G) > 1—A1/An. 


. (Wilf) If G is a connected graph and its largest eigenvalue is \, then y(G) < 


1+. Moreover, equality holds if and only if G' is a complete graph or a cycle 
of odd length. 

Integrality condition: If G is a strongly regular graph with parameters 
(k, A, w), then the quantities 


i (iai- 2 AGl- lane Aa5) 
2 (u— A)? + 4(k — p) 





are non-negative integers. 
The following table gives the automorphism mG of various graphs: 
a ESC 
Cy, forn > 3 

Keg 

Kn 
A graph and its complement have the same group; Aut(G) = Aut(G). 
Frucht’s theorem: Every finite group is the automorphism group of some 
graph. 
If G and G’ are edge isomorphic, then G and G” are not necessarily required 
to be isomorphic. For example, the graphs C3 and 3 are edge isomorphic, but 
not isomorphic. (Two graphs are edge isomorphic if edges are incident in one 
graph if and only if the corresponding edges are incident in the other graph.) 
If the graph G has order n, then the order of its automorphism group |Aut(G’)| 
is a divisor of n!. The order of the automorphism group equals n! if and only 
ifG~K,oGr Kk 





3.3.4.10 Enumeration 
1. The number of labeled graphs of order n is 9(2), 


. Cayley’s formula: The number of labeled trees of order n is n” 
: The number of labeled trees of order n with exactly t end vertices is 


. The number of labeled graphs of order n and size m is ((2)), 
. The number of different ways in which a graph G of order n can be labeled is 


n!/|Aut(G)). 7 


- nm S(n — 2,n —t) for 2 < t < n—1, where S(,) is a Stirling number of the 
second kind. 


. Note the generating functions 


(a) T(z) =r o Linx” = exp (Sr =1 rT (a ) 
(b) t(x) = 2% p tne = T(x) — 4 [T2(z) — T (2?)). 
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7. The number of graphs, and other objects, of different orders. 


Order Graphs Digraphs Trees (tn) Rooted trees (T;,) 
1 


3 
16 
11 218 
34 9608 
156 1540944 
1044 882033440 
12346 1793359192848 
274668 
12005168 


495 4,845 
792 15,504 
924 38,760 
792 77,520 





9. The number of isomorphism classes of graphs of order n having various prop- 
erties: 


nae 
Even 
Eulerian 
Blocks 
Trees 
Rooted trees 


All 5 get 28 
Connected 1 866 256 | 251548592 
Even Qt 271 
Trees 16807 262 144 
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11. The number of isomorphism classes of graphs of order n and size m. 
0 1 1 
1 


63 

148 

345 

402 771 
663 1637 





3.3.4.11 Descriptions of graphs with few vertices 


The small graphs can be described in terms of the operations on page 159. Let Grim 
denote the family of isomorphism classes of graphs of order n and size m. Then 


Gio = {Ki} Gao = {Ka} 

Go,0 = {K2} Ga ={P2U Ko} 

Go = {Ko} Gao = {P3U Ki, Po U Po} 
G30 = {K3} Ga3 = {Pa, K3 U Ky, K1,3} 
G31 ={K2U Ki} G44 = {Cy (K2U Ki) + ky} 
G3,2 = {P3} Ga,5 = {Ka — e} 

G3,3 = {K3} Gao = {Ka} 


3.3.4.12 Matchings 


1. A matching M is a maximum matching if and only if there is no M- 
augmenting path. 

2. Hall’s theorem (Marriage theorem): For a set of vertices V in a graph G, let 
Ne(V) be the set of all vertices adjacent to some element of X. A bipartite 
graph G with bipartition (S, 7’), with |.S| = |T'|, has a perfect matching if and 
only if |X| < |Ng(X)| for every X in S. 

3. KOénig’s theorem: In a bipartite graph, the cardinality of a maximum matching 
equals the cardinality of a minimum vertex cover. 
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3.3.5 TREE DIAGRAMS 


Let T;,,m denote the mah isomorphism class of trees of order n. 
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3.4 COMBINATORIAL DESIGN THEORY 


Combinatorial design theory is the study of families of subsets with various pre- 
scribed regularity properties. An incidence structure is an ordered pair (X, B): 


1. X = {x1,..., Uy} is a set of points. 
2. B= {Bj,..., By} isa set of blocks or lines; each B; C X. 


3. The replication number r; of x; is the number of blocks that contain 7x;. 
4. The size of B; is kj. 


Counting the number of pairs (x, B) with « € B yields >), ri = ae k;. The 
incidence matrix of an incidence structure is the v x b matrix A = (a;;) witha;; = 1 
if x; € B; and 0 otherwise. 


3.4.1. t-DESIGNS 
The incidence structure (X, B) is called a t-(v, k, A) design if 


1. Forall j,k; =kand1<k <v,and 
2. Any subset of ¢ points is contained in exactly \ blocks. 


A 1|-design is equivalent to a v x 6 0-1 matrix with constant row and column sums. 
Every t-(v, k, A) design is also a -(v, k, Ac) design (1 < @ < t), where 


vu—£ k—é 
ee. ay 


A necessary condition for the existence of a t-(v, k, X) design is that A¢ must be an 
integer for all , 1 < @ < t. Another necessary condition is the generalized Fisher’s 
inequality: if t = 2s then b > (*). 


3.4.1.1 Related designs 


The existence of a t-(v, k, A) design also implies the existence of the following de- 
signs: 


Complementary design 
Let Bo = {X\B | B © B}. Then the incidence structure (X, Bc) is a 
t-(v,v—k,A(",) J) ) design (provided v > k +). 

Derived design 
Fix « € X and let Bp = {B\{x} | B € Bwitha € B}. Then the incidence 
structure (X\{x}, Bp) is a (t — 1)-(v — 1,& — 1, A) design. 

Residual design 
Fix « € Xand let Bk = {B | B € Bwitha ¢ B}. Then the incidence 


structure (X\{x}, Br) isa (t—1)-(v—1,k -1, Aa i) ) design. 
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3.4.1.2 Examples 

e 2-(4,3,1)-design: X = {1,2,3,4} and B = {1,2,3}, {2,3,4}, {3,4,1}, 
{4,1,2} vu =4 points, b = 4 blocks, block size k = 3, replication number 
r = 3, \ = 1 (each t = 2 points appear together in one block) 

e 2-(7,3,1)-design: X = {1,2,3,4,5,6,7} and B = {1,2,4}, {2,3,5}, 
{3,4, 6}, {4,5, 7}, {5, 6, 1}, (6, 7, 2}, {7,1,3} vu = 7 points, b = 7 blocks, 
block size k = 3, replication number r = 3, \ = 1 (each t = 2 points appear 
together in one block) 

e 3-(8,4,1)-design: X = {1,2,3,4,5,6,7,8}andB = {1,2,5,6}, {3, 4, 7,8}, 
{1,3,5,7}, {2,4,6,8}, {1,4,5,8}, {2,3,6,7}, {1,2,3,4}, {5,6,7,8}, 
{1, 2,7, 8}, {3, 4,5, 6}, {1, 3,6, 8}, {2,4,5, 7}, {1, 4,6, 7}, {2, 3,5, 8} 

v = 8 points, b = 14 blocks, block size k = 4, replication number r = 7, 
A = 1 (each t = 3 points appear together in one block) 

e 2-(8,4,3)-design: X = {1,2,3,4,5,6,7,8}andB = {1,3,7,8}, {1, 2,4, 8}, 
{2,3,5,8}, {3,4,6,8}, {4,5,7,8}, {1,5,6,8}, {2,6,7,8}, {1,2,3,6}, 
{1, 2,5, 7}, {1, 3,4, 5}, {1, 4, 6, 7}, {2,3,4, 7}, {2, 4,5, 6}, {3,5,6,7} v= 
8 points, b = 14 blocks, block size k = 4, replication number r = 7, \ = 3 
(each t = 2 points appear together in three blocks) 


3.4.2. BALANCED INCOMPLETE BLOCK DESIGNS (BIBDS) 


Balanced incomplete block designs (BIBDs) are t-designs with t = 2, so that every 
pair of points is on the same number of blocks. The relevant parameters are v, b, r, 
k, and A with 


or = bk and vo(u — 1)A = bk(k — 1). (3.4.2) 
If A is the v x b incidence matrix, then AAT = (r — \)I, + AJy, where I, is the 
nm X nidentity matrix and J,, is the n x n matrix of all ones. 
3.4.2.1. Symmetric designs 


Fisher’s inequality states that b > v. If b = v (equivalently, r = k), then the BIBD 
is called a symmetric design, denoted as a (v, k, A)-design. The incidence matrix for 
a symmetric design satisfies 


JA=hig= AJ, and ATA=(k-—NE+AA, (3.4.3) 


that is, any two blocks intersect in \ points. The dualness of symmetric designs can 
be summarized by the following: 


v points «<—  v blocks, 
k blocks on a point «<—  k points in a block, and 
Any two points on A blocks <«—> Any two blocks share X points. 


Some necessary conditions for symmetric designs are 


1. If v is even, then / — A is a square integer. 
2. Bruck-Ryser—Chowla theorem: If v is odd, then the following equation has 
integer solutions (not all zero): 


a? = (k— d)y? + (-1)@-Y/?dz?. 
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3.4.2.2 Existence table for BIBDs 

Some of the most fruitful construction methods for BIBD are dealt with in sepa- 
rate sections, difference sets (page 174), finite geometry (page 176), Steiner triple 
systems (page 180), and Hadamard matrices (page 87). The table below gives all 
parameters for which BIBDs exist with k < v/2 and b < 30. 


pot by] r{eRyAy | of 6] rf eyAT | of bt rp klA 
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3.4.3. DIFFERENCE SETS 


Let G be a finite group of order v (see page 106). A subset D of size k is a (v, k, A)- 
difference set in G if every non-identity element of G can be written \ times as 
a “difference” dj dy 1 with d, and dy in D. If G is the cyclic group Z,, then the 
difference set is a cyclic difference set. The order of a difference set isn = k — AX. 
For example, {1, 2,4} is a (7,3, 1) cyclic difference set of order 2. 

The existence of a (v, k, \)-difference set implies the existence of a (uv, k, A)- 
design. The points are the elements of G' and the blocks are the translates of D: all 
sets Dg = {dg : d € D} forg € G. Note that each translate Dg is itself a difference 
set. 


EXAMPLES 


1. Here are the 7 blocks for a (7,3, 1)-design based on D = {1, 2, 4}: 
124 235 346 450 561 602 013 
2. A (16, 6, 2)-difference set in G = Zz © Zz © Zz O Zz is 





0000 0001 0010 0100 1000 1111 


3. A (21,5, 1)-difference set in G = (a, b:a° =b' =1,a 1ba = a*) is 
{a, a”, b, b?, b*}. 
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3.4.3.1 Some families of cyclic difference sets 


Paley: Let v be a prime congruent to 3 modulo 4. Then the non-zero squares in Z,, 
forma (v, (u—1)/2, (v—3) /4)-difference set. Example: (v,&, A) = (11,5, 2). 

Stanton-Sprott: Let v = p(p + 2), where p and p + 2 are both primes. Then there 
is a (v, (vu — 1)/2, (v — 3) /4)-difference set. Example: (v,k, A) = (35, 17,8). 

Biquadratic residues (I): If v = 4a? + 1 is a prime with a odd, then the non- 
zero fourth powers modulo v form a (v, (v — 1)/4, (vu — 5)/16)-difference set. 
Example: (v,k, A) = (37,9, 2). 

Biquadratic residues (II): If v = 4a? + 9 is a prime with a odd, then zero and 
the fourth powers modulo v form a (v, (v + 3)/4, (v + 3)/16)-difference set. 
Example: (v,k, A) = (18,4, 1). 

Singer: If q is a prime power, then there exists a 
(— 1 grote 1 gr 1 


<< 5 -difference set for all m > 3. 
ci wes ae | 





3.4.3.2 Existence table of cyclic difference sets 


This table gives all cyclic difference sets for k < v/2 and v < 50 up to equivalence 
by translation and multiplication by a number relatively prime to v. 


7 3 2/124 

13459 

0139 
01245810 
145679111617 


36712 14 

12346891213 1618 

15 11 2425 27 

123468 12 15 16 17 23 24 27 29 30 
1245789 10 14 16 18 19 20 25 28 


013479 11 12 13 14 16 17 21 27 28 29 33 

179 10 12 16 26 33 34 

123569 14 15 18 20 25 27 35 

12345811 12 16 19 20 21 22 27 32 33 35 37 39 41 42 
1469 10 11 13 14 15 16 17 21 23 24 25 31 35 36 38 40 41 


12346789 12 14 1617 18 21 24 25 27 28 32 34 36 37 
42 


—_— 


_ 


5 
4 
7 
9 
5 
1 
6 
> 
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3.4.4 FINITE GEOMETRY 
3.4.4.1 Affine planes 


A finite affine plane is a finite set of points together with subsets of points called 
lines that satisfy the axioms: 


1. Any two points are on exactly one line. 

2. (Parallel postulate) Given a point P and a line L not containing P, there is 
exactly one line through P that does not intersect L. 

3. There are four points, no three of which are collinear. 


These axioms are sufficient to show that a finite affine plane is a BIBD (see page 
173) with 

v=nr b=n?4+n r=n4+1 k=n A=1 
(n is called the order of the plane). The lines of an affine plane can be divided into 
n-+1 parallel classes each containing n lines. A sufficient condition for affine planes 


to exist is for n to be a prime power. 
Below are two views of the affine plane of order 2 showing the parallel classes. 





Sy 
Here is the affine plane of order 3 showing the parallel classes. (2 
3.4.4.2 Projective planes eS) 


A finite projective plane is a finite set of points together with subsets of points called 
lines that satisfy the axioms: 


1. Any two points are on exactly one line. 
2. Any two lines intersect in exactly one point. 
3. There are four points, no three of which are collinear. 


These axioms are sufficient to show that a finite affine plane is a symmetric design 
(see page 173) with 


ven ?+n+1 k=n+1 A=1 (3.4.4) 


(n is the order of the plane). A sufficient condition for affine planes to exist is for n 
to be a prime power. 

A projective plane of order n can be constructed from an affine plane of order n 
by adding a line at infinity. A line of n + 1 new points is added to the affine plane. 
For each parallel class, one distinct new point is added to each line. The construction 
works in reverse: removing any one line from a projective plane of order n and its 


points leaves an affine plane of order n. 
To the right is the projective plane of order 2. The center circle 


functions as a line at infinity; removing it produces the affine plane 
of order 2. 
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3.4.5 FINITE FIELDS 


Pertinent definitions for finite fields may be found in Section 2.5.8 on page 117. 
3.4.5.1 Irreducible polynomials 


Let N,(n) be the number of monic irreducible polynomials of degree n over GF(q). 
Then 


q’ = dN,(d) and = Ng(n) =— Sow (=) q’, (3.4.5) 
d|n d\n 


where ju(-) is the number theoretic Mébius function (see page 36). 


3.4.5.2 Table of binary irreducible polynomials 

The table lists the non-zero coefficients of binary irreducible polynomials, e.g., 2 1 0 
corresponds to x?+a2!+a° = x?+a+1. The exponent of an irreducible polynomial 
is the smallest L such that f(a) divides x” — 1. A “P” after the exponent indicates 


that the polynomial is primitive. 


310 7P 
410 15P 


420 15P 
43210 


710 127P 
730 127P 


7543210 
760 
76310 
76410 
76420 
76520 
7653210 
76540 
7654210 
7654320 
84310 
84320 
85310 
85320 
85430 
8543210 
86320 


8643210 
86510 
86520 
86530 
86540 
8654210 
8654310 
87210 
87310 
87320 
8743210 
87510 
87530 
87540 
8754320 
87610 
8763210 
8764210 
8764320 
8765210 
8765410 
8765420 
8765430 
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3.4.5.3 Table of binary primitive polynomials 


Listed below! are primitive polynomials, with the least number of non-zero terms, 
of degree from | to 64. Only the exponents of the non-zero terms are listed. For 


example the entry “2 1 0” corresponds to x? + # + 1. 


126410 
134310 


145310 
1510 
165320 
1730 
185210 
195210 
2030 
2120 
2210 
2350 
244310 
25 30 
266210 


3.4.6 GRAY CODE 


A Gray code is a sequence ordering such that a small change in the sequence number 
results in a small change in the sequence. The standard recursive construction for 


275210 
28 3 0 
2920 
306410 
3130 
32753210 
336410 
34765210 
35 20 
36654210 
37543210 
386510 
39 40 


sed 
Gray codes is Gn = 0Gn_1, 1G. 


EXAMPLES 


1. The four 2-bit strings can be ordered so that adjacent bit strings differ in only 1 bit: 


{00, 01, 11, 10}. 


2. The eight 3-bit strings can be ordered so that adjacent bit strings differ in only 1 bit: 


{000, 001, 011, 010, 110, 111, 101, 100}. 


3. The sixteen 4-bit strings can be ordered so that adjacent bit strings differ in only 1 bit: 


405430 
4130 
42543210 
436430 
446520 
454310 
46853210 
4750 
48754210 
496540 
504320 
516310 
5230 


536210 
54654320 
556210 
567420 
3732.0 
586510 
59654310 
6010 
615210 
626530 
63 10 
644310 





{0000, 0001, 0011, 0010, 0110, 0111, 0101, 0100, 1100, 1101, 1111, 1110, 1010, 
1011, 1001, 1000}. 


4. The subsets of {a, b, c} can be ordered so that adjacent subsets differ by only the 
insertion or deletion of a single element: 


''Taken in part from “Primitive Polynomials (Mod 2),” E. J. Watson, Math. Comp., 16, 368-369, 1962. 


{a}, 


{a,b}, {0}, 


{b,c}, 


{a, b, ch, 


{a,c}, 


{ch}. 
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3.4.7. LATIN SQUARES 


A Latin square of size n is ann x n array S = [s;;] of n symbols such that every 
symbol appears exactly once in each row and column. Two Latin squares S and T 
are orthogonal if every pair of symbols occurs exactly once as a pair (s;;,t;;). Let 
M(n) be the maximum size of a set of mutually orthogonal Latin squares (MOLS). 


ARLYN 
= >> 

== 
aS 


The existence of n — 1 MOLS of size n is equivalent to the existence of an affine 
plane of order n (see page 176). 


3.4.7.1. Examples of mutually orthogonal Latin squares 
These are complete sets of MOLS for n = 3, 4, and 5. 





These are two superimposed MOLS for n = 7 and n = 8. 


n=8 
POOL [3335 [44 [5 [66 [TT 
ria fos] 30 [21 [56 47 [74 [os 
pea} 35 [os] 17 [oo] 71 [42] 53) 
p35 [32 [i [oo P77} 66 [35 [aa 


[46 [37 [64] 75 [02] 13 [20 [3 
ps7 [46 [75 | 64 | 13 [02 [31 [20 
P6574 [47 [56 [21 [30 [03 | 1 
p71 Poo [S3 [42 [35 [24 [17 [6 
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3.4.8 STEINER TRIPLE SYSTEMS 


A Steiner triple system (STS) is a 2-(v,3,1) design. In particular, STSs are BIBDs 
(see page 173). STSs exist if and only if v = 1 or 3 (mod 6). The number of blocks 
in an STS is b = v(v — 1)/6. 


3.4.8.1. Some families of Steiner triple systems 


uv = 2™—1: Take as points all non-zero vectors over Zz of length m. A block 
consists of any set of three distinct vectors {x, y, z} such that x + y+ z= 0. 

uv = 3™: Take as points all vectors over Z3 of length m. A block consists of any set 
of three distinct vectors {x, y, z} such that «+ y + z = 0. 


3.4.8.2 Resolvable Steiner triple systems 


An STS is resolvable if the blocks can be divided into parallel classes such that each 
point occurs in exactly one block per class. A resolvable STS exists if and only if 
v = 3 (mod 6). For example, the affine plane of order 3 is a resolvable STS with 
uv = 9 (see page 176). 

A resolvable STS with v = 15 (b = 35) is known as the Kirkman schoolgirl 
problem and dates from 1850. Each column of 5 triples is a parallel class: 


abi ac j adk ael afm agn aho 
cdf deg efh fgb ghe hbd bce 
gjo hki bl F cmk dnl eom £ in 
ekn flo gmi hn j bok ea 1 djm 
him bmn cno doi eij £ ick gkl 


3.4.9 DESIGNS AND HADAMARD MATRICES 


See page 87 for Hadamard matrices. 


BIBDs: Let H be a Hadamard matrix of order 4t, normalized so the first row and 
column are 1’s. Remove the first row and column. Let A be the remaining 
(4t — 1) x (4t — 1) matrix. If J is the (4¢ — 1) x (4¢ — 1) matrix of all ones, 
then the incidence matrix 


e fora 2-(4t — 1, 2t— 1,t— 1) design is given by (J + A). 
e fora 2-(4t — 1, 2t, t) design is given by $(J — A). 


3-Designs: Let H be a Hadamard matrix of order 4¢. Choose any row and normal- 
ize it (scale the columns as needed) so that every entry is +1. Let the columns 
represent points. Let the sets of columns carrying +1s and —1s in all but the 
chosen row be blocks. This results in a 3-(4t, 2t, t — 1) design; it is an affine 
design. Different choices of row may, or may not, give isomorphic designs. 
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3.4.10 ROOK POLYNOMIALS 


Consider an n x m board in which some certain squares are forbidden (shown white) 
and others are acceptable (shown dark). Let r;,(B) be the number of ways to choose 
k; acceptable (darkened) squares, no two of which lie in the same row and no two of 
which lie in the same column. (This scenario might arise from a job assignment.) 
Equivalently, in how many ways can k rooks be placed on a board’s dark squares in 
such a way that no two can take each other? The expression 


R(«, B) = ro(B) +1i1(B)x + ro(B)z? +... (3.4.6) 
is the board’s rook polynomial. 


Consider the 2 x 2 board By = tal . For this board there is | way to place 
no rooks, 2 ways to place one rook (use either darkened square), | way to place two 
rooks (use both darkened squares), and no way to place more than two rooks. Hence, 
R(a, By) =1+2¢ +27. 


Consider the 2 x 2 board Bj = (MIM). For this board there is 1 way to place 
no rooks, 4 ways to place one rook (use any square), 2 ways to place two rooks (use 
diagonal squares), and no way to place more than two rooks. Hence, R(x, Bz) = 
1+ 4a + 22. 

Suppose I is a set of darkened squares in a board B and By is the board obtained 
from B by lightening the darkened squares in B that are not in J. If the darkened 
squares in B are partitioned into two sets, [ and .J, such that no square in J lies in the 
same row or column as any square of J, then B; and B decompose the board B. In 
this case: R(x, B) = R(a, Bi) R(x, Bz). See the following example. 





By 

Suppose that s is any darkened square in a board B. Let Bs be obtained from 
B by lightening s. Let B4, be obtained from B by lightening all squares in the same 
row and column as s. Then R(#, B) = R(x, Bs) + R(x, BS). (See the following 
example, where s is the darkened square in row 3, column 3.) 


[om] fot} o_o] Pats 
|_ lot to) |_ ott 
| lo) | to 

B’ 


B Bs 
EXAMPLES _ Forasquare checkerboard in which every square is darkened (B,,), the rook 
polynomial is R(x, Bn) = n! a” Ln (—+), where Ln is the n Laguerre polynomial. 


OO00 
O00 OO00 
OOO OOOO 
OOO OOOO 
R(x, B3) = 1+ 9a + 182? + 6x3 R(x, Ba) = 14 16x + 72a? + 96x3 + 242+ 


We find R(x, Bs) = 1+ 25x + 200x? + 600zx° + 600x4 + 120z°. 
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3.4.11 BINARY SEQUENCES 
3.4.11.1 Barker sequences 








A Barker sequence (s1,...,8n) with s; = +1 has airy $;8j4; = +1 or 0, for 
2=1 , N — 1. The following table lists all known Barker sequences (up to 


pee 


reversal, multiplication by —1, and multiplying alternate values by —1). 





























3.4.11.2 Periodic sequences 


Let s = (80, 51,...,5N—1) be a periodic sequence with period N. A (left) shift 
of s is the sequence (s1,...,5\—1, 80). For 7 relatively prime to N, the decima- 
tion of s is the sequence (80, $7, 527,--.), which also has period N. The periodic 
autocorrelation is defined as the vector (ao,...,@y—1), with 
N-1 
a, = oS SRei tas (subscripts taken modulo JV). (3.4.7) 
j=0 


An autocorrelation is two-valued if all values are equal except possibly for the 0" 
term. 


3.4.11.3. The m-sequences 
A binary m-sequence of length N = 2” — 1 is the sequence of period N defined by 
($0, 81; ++,8N—1), s; = Tr(a"), (3.4.8) 


where a is a primitive element of GF(2") and Tr is the trace function from GF(2") 
to GF(2).? 
1. All m-sequences of a given length are equivalent under decimation. 
2. Binary m-sequences have a two-valued autocorrelation (with the identification 
that 0 < +1 and1< —1). 
3. All m-sequences possess the span property: all binary r-tuples occur in the 
sequence except the all-zeros r-tuple. 


The existence of a binary sequence of length 2” — 1 with a two-valued autocor- 
relation is equivalent to the existence of a cyclic difference set with parameters 
(2% — 1,99") — 1,2°-* — 1), 





If 2 € F = GF(q™) and K = GF(q), the trace function Trr/K (x) from F onto K is defined by 
m=1 


TrpK(@) =@+at+---+ a4 
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3.4.11.4 Shift registers 


Below are examples of the two types of shift registers used to generate binary ™m- 
sequences. The generating polynomial in each case is x+ + x + 1, the initial register 
loading is 1 0 0 0, and the generated sequence is {0, 0, 0, 1, 0,0, 1, 1, 0, 1,0, 1,1, 1, 


i 


Additive shift register Multiplicative shift register 


3.4.11.5 Binary sequences with two-valued autocorrelation 


The following table lists all binary sequences with two-valued periodic autocorrela- 
tion of length 2” — 1 for n = 3 to 8 (up to shifts, decimations, and complementation). 
The table indicates the positions of 0; the remaining values are 1. An S indicates that 
the sequence has the span property. 





Positions of 0 

124 

q 01245810 
123468 12 15 16 17 23 24 27 29 30 
1245789 10 14 16 18 19 20 25 28 

6 012346789 12 13 14 16 18 19 24 26 27 28 32 33 35 36 38 41 45 48 49 52 54.56 

6 012345689 10 12 1617 18 20 23 24 27 29 32 33 34 36 40 43 45 46 48 53 54 58 
1248911 13 15 1617 18 19 21 22 25 26 30 31 32 34 35 30 37 3841 42 44 47 49 50 52 60 61 62 64 68 
69 70 71 72 73 74 76 79 81 82 84 87 88 94 98 99 100 103 104 107 113 115 117 120 121 122 124 
12345678 10 12 14 16 19 20 23 24 25 27 28 32 33 38 40 46 47 48 50 51 54 56 57 61 63 64 65 66 67 
73 75 76 77 80 87 89 92 94.95 96 97 100 101 102 107 108 111 112 114 117 119 122 123 125 126 
12346789 12 1415 1617 18 24 27 28 29 30 31 32 34 36 39 47 48 51 54 56 58 60 Ol 62 64 65 67 68 
71 72 77 78 79 83 87 89 94.96 97 99 102 103 105 107 108 112 113 115 116 117 120 121 122 124 
12346789 12 13 14 16 17 18 19 24 25 26 27 28 31 32 34 35 36 38 47 48 50 51 52 54 56 61 62 64 65 
67 68 70 72 73 76 77 79 81 87 89 94.96 97 100 102 103 104 107 108 112 115 117 121 122 124 
12345689 10 12 15 1617 18 19 20 24 25 27 29 30 32 33 34 36 38 39 40 48 50 51 54 55 58 59 60 64 
65 66 68 71 72 73 76 77 78 80 83 89 91 93 96 99 100 102 105 108 109 110 113 116 118 120 
12345681011 121619 20 21 22 24 25 27 29 32 33 37 38 39 4041 42 44 48 49 50 51 54.58 63 64 65 
66 69 73 74 76 77 78 80 82 83 84 88 89 95 96 98 100 102 105 108 111 116 119 123 125 126 


LOS | 
” 01234678 12 13 14 1617 19 23 24 25 26 27 28 31 32 34.35 37 3841 45 46 48 49 50 51 52 54.5659 
a 
s 
s 








62 64 67 68 70 73 74 75 76 82 85 90 92 96 98 99 100 102 103 104 105 108 111 112 113 118 119 123 124 
127 128 129 131 134 136 137 139 140 141 143 145 146 148 150 152 153 157 161 164 165 170 177 179 
180 183 184 187 189 191 192 193 196 197 198 199 200 204 206 208 210 216 217 219 221 222 223 224 
226 227 236 237 238 239 241 246 247 248 251 253 254 
012478911 141617 18 19 21 22 23 25 27 28 29 32 33 34 35 36 38 42 43 44 46 49 50 51 5456 58 61 
64 66 68 69 70 71 72 76 79 81 84 85 86 87 88 89 92 93 95 97 98 99 100 101 102 108 112 113 116 117 119 
122 125 128 32 133 136 137 138 139 140 141 142 144 145 149 152 153 158 162 163 167 168 170 
171 172 174 76 177 178 184 186 187 190 193 194 196 197 198 200 202 204 209 211 213 215 216 





0123468 12 13 15 1617 24 25 26 27 29 30 31 32 34 35 39 47 48 50 51 52 54.57 58 59 60 61 62 64 67 
68 70 71 78 79 85 91 94 96 99 100 102 103 104 107 108 109 114 116 118 119 120 121 122 124 127 128 
129 134 135 40 141 142 143 145 147 151 153 156 157 158 161 163 167 170 173 177 179 181 182 
187 188 191 95 198 199 200 201 203 204 206 208 209 211 214 216 217 218 221 223 225 227 228 
229 232 233 236 238 239 240 241 242 244 247 248 251 253 254 

0123467811 12 14 15 1617 21 22 23 24 25 28 29 30 32 34 35 37 41 42 44 46 47 48 50 51 50 58 60 64 
68 69 70 71 73 74 81 82 84 85 88 91 92 94 96 97 100 102 107 109 111 112 113 116 119 120 121 123 127 
128 129 131 133 135 136 138 139 140 142 145 146 148 151 153 162 163 164 168 170 173 176 181 182 
183 184 187 188 189 191 192 193 194 195 197 200 203 204 209 214 218 219 221 222 223 224 225 226 
229 232 237 238 239 240 242 246 247 251 253 254 





























184 CHAPTER 3. DISCRETE MATHEMATICS 





3.5 DIFFERENCE EQUATIONS 


In many ways, difference equations are analogous to differential equations. 


3.5.1 THE CALCULUS OF FINITE DIFFERENCES 


1. A(f(x)) = f(a +h) — f(x) (forward difference). 
2. A%(F(a)) = fle + 2h) — 2F(e + h) + FW). 


(F(@)) = A(A"'(FC@)) = DO (A) le + (a BY). 


k=0 


ee 
a 
3 


3.5.2 EXISTENCE AND UNIQUENESS 
A difference equation of order k has the form 


Tn+k = Fite: Int r++: sme) (3.5.1) 
where f is a given function and k is a positive integer. A solution to Equation (3.5.1) is 
a sequence of numbers eee which satisfies the equation. Any constant solution 
of Equation (3.5.1) is called an equilibrium solution. 


A linear difference equation of order k is one that can written in the form 


a” on4k = on tp seedy a ae a tn—1 +P a en = Gn; (3.5.2) 


where k is a positive integer and the coefficients al? ) ere al® ) along with {g,,} are 


known. If the sequence g,, is identically zero, then Equation (3.5.2) is called homo- 
geneous; otherwise, it is called non-homogeneous. If the coefficients a? a 2 al®) 
are constants (i.e., do not depend on 7), Equation (3.5.2) is a difference equation with 


constant coefficients; otherwise it is a difference equation with variable coefficients. 


THEOREM 3.5.1 (Existence and uniqueness) 
Consider the initial value problem (IVP) 


Intk + Bee see pay Se OY on 44 - WO rn = Fas 
Li= A, 4=0,1,...,k6—1, 


forn = 0,1,..., where E@ and fp, are given sequences with po # 0 for all n and 


the {a;} are given initial conditions. Then the above equations have exactly one 
solution. 


(3.5.3) 
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3.5.3. LINEAR INDEPENDENCE: GENERAL SOLUTION 


The sequences x), ?),..., x(*) (sequence «™ has the terms {o, a}, a}, ananh) 
are linearly dependent if constants c1, C2, ..., Ck (not all of them zero) exist such that 
k * 
Ss qx =0 forn=0,1,.... (3.5.4) 
i=1 
Otherwise the sequences t), ¢?),..., 0) are linearly independent. 
The Casoratian of the k sequences x“), 7), ..., 2") is the k x k determinant 
ah) a?) Ps 
. (1) (2) — (k) 
C (an a?) tans x) = Tn+1 Tn+y Tr41 . (3.5.5) 
7 Si ates - ings baceabwrha we oo 
Tntk—1 Unt+k—-1 ~ Tnt+k—-1 
THEOREM 3.5.2 
The solutions ae), ge), alee ok) of the linear homogeneous difference equation, 


(k—-1) 


Sng hth tng (ery te +O ang +0. an =0,  n=0,1,..., (3.5.6) 


are linearly independent if and only if their Casoratian is different from zero for 
n= 0. 


Note that the solutions to Equation (3.5.6) form a k-dimensional vector space. 
The set {a ,2®),..., 2°} is a fundamental system of solutions for Equation 
(3.5.6) if and only if the sequences x, x), ..., x are linearly independent 
solutions of the homogeneous difference Equation (3.5.6). 


THEOREM 3.5.3 


Consider the non-homogeneous linear difference equation 

Sng kh tO Pang) te +O angi t0M an =dn,  n=0,1,... 3.5.7) 
where p® and d,, are given sequences. Let oh”) be the general solution of the corre- 
sponding homogeneous equation 


(k-1 


Intk + bn atthe) at Te Oe tnt 7 oY an =0, n=0,1,..., 


and let a?) be a particular solution of Equation (3.5.7). Then a?) + a) 


general solution of Equation (3.5.7). 


is the 


THEOREM 3.5.4 (Superposition principle) 


Let x) and x) be solutions of the non-homogeneous linear difference equations 


In+k + Oe en (ety pees WP tn 44 + DO) an = An, N= 0, 1, Sankey 
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and 
In+k + BE) aes (e—1) ae OY nat — oY tn = Bn; n= 0, 1, sey 


respectively, where b® and {an} and {By} are given sequences. Then a) + x) 
is a solution of the equation 


) 


In+k + BY st cep a OY nat F oe In =An+Bn, n=O0,1,.... 


3.5.4 HOMOGENEOUS EQUATIONS WITH CONSTANT 
COEFFICIENTS 


The results given below for second-order linear difference equations extend naturally 
to higher order equations. 
Consider the second-order linear homogeneous difference equation, 
A2Q%n42 + A1Fn4+1 + AQLy = 0, (3.5.8) 


where the {a;} are real constant coefficients with a2a9 # 0. The characteristic 
equation corresponding to Equation (3.5.8) is defined as the quadratic equation 


apd? +ayrA + a9 = 0. (3.5.9) 


The solutions \;, A2 of the characteristic equation are the eigenvalues or the charac- 
teristic roots of Equation (3.5.8). 


THEOREM 3.5.5 
Let 1 and X2 be the eigenvalues of Equation (3.5.8). Then the general solution of 
Equation (3.5.8) is given as described below with arbitrary constants cy and c2. 


Case 1: A, 4 A2 with X41, A2 € R (real and distinct roots). 
The general solution is given by &n, = c,A} + C2A4. 


Case 2: A, = A2 € R (real and equal roots) . 
The general solution is given by &» = c,A} + cond}. 





Case 3: \; = 2 (complex conjugate roots). 
Suppose that \, = re’®. The general solution is given by 


Ln = cir” cos(nd) + cor” sin(n¢@). 


The constants {c1, cz} are determined from the initial conditions. 
EXAMPLE The unique solution of the initial value problem 
Fuse = Fr4it Fh, = 0; ese 5 


(3.5.10) 
Fyo=0, K=1, 


is the Fibonacci sequence. The equation \7 = \ + 1 has the real and distinct roots 


14V5 
M2=> 


7 1 fae fe n Laws n 7 
=e |( 5 )-( 5 ) |. n=0,1,.... (3.5.11) 








. Using Theorem 3.5.5 the solution is 
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3.5.5 NON-HOMOGENEOUS EQUATIONS 


THEOREM 3.5.6 = (Variation of parameters) 
Consider the difference equation, Xn42 + An%n41 + Bntn = Yn, where {an}, 
{Bn}, and {ym} are given sequences with By, # 0. Let a and x) be two linearly 
independent solutions of the homogeneous equation corresponding to this equation. 
A particular solution xP) has the component values a?) = a) uy) tal?) y?) where 
the sequences v) and v) satisfy the following system of equations: 
a) Gea — oy) + ao), (uf, _ vl) =0, and 


n+ nt 


(3.5.12) 
oc), (of, = vf) +r o®), (of), = wf) = 7n- 

















3.5.6 GENERATING FUNCTIONS AND Z TRANSFORMS 


Generating functions can be used to solve initial value problems of difference equa- 
tions in the same way that Laplace transforms are used to solve initial value problems 
of differential equations. 

The generating function of the sequence {x,,}, denoted by G[z,,], is defined by 
the infinite series 


Cal > ae” (3.5.13) 
n=0 


provided that the series converges for |s| < 1, for some positive number r. The 
following are useful properties of the generating function: 


1. Linearity: G [cian + C2Yn| =caG [tn] +cG [yn] : 
k-1 
1 
2. Ti lati inv | >Gltnir| = = G ni} ns” |. 
ranslation invariance: G |%n+r| e: ( [Ln] ae 8 


3. Uniqueness: G [ap] = G [yn] CT =U, for n= 0;15.e0: 








The Z-transform of a sequence {x,, } is denoted by Z[x,,] and is defined by the 
infinite series, 


Z[cn])= 5° (3.5.14) 


provided that the series converges for |z| > r, for some positive number r. (The 
Z-transform is also in Section 6.40 on page 512.) 

Comparing the definitions for the generating function and the Z-transform one 
can see that they are connected because Equation (3.5.14) can be obtained from 


Equation (3.5.13) by setting s = z~1. 
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3.5.6.1 Generating functions for some common sequences 





as sin 3 
1 — 2ascos 8 4 











1 k-1 
oF (« [Ln] — > ont 


n=0 


3.5.7 CLOSED-FORM SOLUTIONS FOR SPECIAL EQUATIONS 


In general, it is difficult to find a closed-form solution for a difference equation which 
is not linear of order one or linear of any order with constant coefficients. A few spe- 
cial difference equations which possess closed-form solutions are presented below. 


3.5.7.1 First-order equation 


The general solution of the first-order linear difference equation with variable 
coefficients, 


In+1 — AnLn = Pn, n= 0,1,.%.5 (3.5.15) 
is given by 
n-1 n—2 n-1 
In = (1 os) to+ >) ( II os) Bm+Bn1, n=0,1,..., (3.5.16) 
k=0 m=0 \k=m+1 


where Zo is an arbitrary constant. 
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3.5.7.2 Riccati equation 


Consider the non-linear first-order equation, 





tig CO I Gsiy 
Yntn i i On, 
where Qn, Bn, Yn, On are given sequences of real numbers with 
yn £0 and - - #0, n=0,1,.... (3.5.18) 








The following statements are true: 


1. The change of variables, 





Se Sac be, Sen, 
Un (3.5.19) 
Uo = Ii, 


reduces Equation (3.5.17) to the linear second-order equation, 
Un+2 = AnUn+1 + Brun, n= 0, 1. igs 
uo = 1, (3.5.20) 


U1 = Yoo + do, 








where An = On+1 + Qn, a : and Bn = (Bn Yn _— QnOn) eae 


n Yn 
. Let «) be a particular solution of Equation (3.5.17). The change of variables, 
1 
Un = wm? n= Ol sea83 (3.5.21) 
In — ao 


reduces Equation (3.5.17) to the linear first-order equation, 





Unt1 + Crtn + Dn = 0, = 0) dyes (3.5.22) 
(yal? + bn) Vn (van? + én) 
where C;, = ae a =. and D,, = rie i 
. Let ¢ and x?) be two particular solutions of Equation (3.5.17) with a) # 
a?) forn = 0,1,.... Then the change of variables, 
1 1 
a ey On ey ea Oa ere (3.5.23) 


reduces Equation (3.5.17) to the linear homogeneous first-order equation, 


Wn4itEnwn=0, n=0,1,..., (3.5.24) 


(nen mS én). 


where £,, = —__. 
" BnY¥n a Andn 
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3.5.7.3 Logistic equation 
Consider the initial value problem 


ng = Pn (1- =), n=O0,1)..., 


ro =a, with a € [0, k], 


where r and & are positive numbers with r < 4. The following are true: 


1. When r = k = 4, Equation (3.5.25) reduces to 


2 
Ln4+1 = 4in — ZX. 


(3.5.25) 


(3.5.26) 


If a = 4sin?(0) with @ € [0, 3], then Equation (3.5.26) has the closed-form 


solution 
In41 = 4sin?(2"*19), n=0,1,..., 
ay = 4sin?(6), with @-€ [0, “| 
2. When r = 4 and k = 1, Equation (3.5.25) reduces to 


Ln41 = 4en, —- Ag”. 


(3.5.27) 


(3.5.28) 


If a = sin?() with 6 € [0,4], then Equation (3.5.28) has the closed-form 


12 
solution 


En+i = sin?(2"419), n=0,1,..., 


azo = sin?(6), with 6 € [o. |. 


(3.5.29) 
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4.1 EUCLIDEAN GEOMETRY 


Euclidean geometry is based on 5 axioms: 
1. One can draw a straight line from any point to any point. 
2. One can extend a finite straight line continuously in a straight line. 
3. One can describe a circle with any center and radius. 


4. All right angles are equal to one another. 
5. If a straight line falling on two straight lines make the interior angles on the 


same side less than two right angles, the two straight lines, if produced indef- 
initely, meet on that side where the angles are less than the two right angles. 


(Parallel Postulate) 


A logically equivalent formulation of the parallel postulate is Playfair’s postulate: 
e (5’) Through a point not on a given straight line, at most one line can be drawn 


that never meets the given line. 


The essential difference between Euclidean and non-Euclidean geometry is the na- 
ture of parallel lines. Changing the parallel postulate results in other geometries: 

e (5; for hyperbolic geometry) Through a point not on a given straight line, in- 
finitely many lines can be drawn that never meet the given line. For example, 
the surface of a hyperboloid is an example of hyperbolic geometry. 

e (5; for elliptic geometry) Through a point not on a given straight line, no lines 
can be drawn that never meet the given line. For example, the surface of a 


sphere is an example of elliptic geometry. 
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4.3 COORDINATE SYSTEMS IN THE PLANE 


4.3.1 CONVENTION 


When we talk about “the point with coordinates (x, y)” or “the curve with equation 
y = f(«),” we always mean Cartesian coordinates. If a formula involves other 
coordinates, this fact will be stated explicitly. 


4.3.2 SUBSTITUTIONS AND TRANSFORMATIONS 


Formulas for changes in coordinate systems can lead to confusion because (for ex- 
ample) moving the coordinate axes up has the same effect on equations as moving 
objects down while the axes stay fixed. (To read the next paragraph, you can move 
your eyes down or slide the page up.) 

To avoid confusion, we will carefully distinguish between transformations of 
the plane and substitutions, as explained below. Similar considerations will apply to 
transformations and substitutions in three dimensions (Section 4.13). 


4.3.2.1 Substitutions 


A substitution, or change of coordinates, relates the coordinates of a point in one 
coordinate system to those of the same point in a different coordinate system. Usually 
one coordinate system has the superscript ’ and the other does not, and we write 


ti en or = (a, y) = F(z’, y’) (4.3.1) 


y= Bie, y’), 


(where subscripts and primes are not derivatives, they are coordinates). This means: 
given the equation of an object in the unprimed coordinate system, one obtains 
the equation of the same object in the primed coordinate system by substituting 
F,(2', y’) for x and F(a’, y’) for y in the equation. For instance, suppose the primed 
coordinate system is obtained from the unprimed system by moving the x axis up a 
distance d. Then x = x’ and y = y’ +d. The circle with equations x? + y? = 1 in 
the unprimed system has equations ’” + (y’ + d)? = 1 in the primed system. Thus, 
transforming an implicit equation in (a, y) into one in («’, y’) is immediate. 

The point P = (a,b) in the unprimed system, with equation x = a, y = 6b, 
has equation F,,(2’, y’) = a, F,(«’,y’) = 6 in the new system. To get the primed 
coordinates explicitly, one must solve for x’ and y’ (in the example just given we 
have x’ = a, y’ +d = b, which yields x’ = a, y’ = b — d). Therefore, if possible, 
we give the inverse equations 


a! = Gui (x,y), 
y! = , 


G, (x, y) or (a, y') = G(z, y); 
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which are equivalent to Equation (4.3.1) if G(F(a’,y’)) = (a’,y’) and 
F(G(a,y)) = (a,y). Then to go from the unprimed to the primed system, one 
merely inserts the known values of x and y into these equations. This is also the 
best strategy when dealing with a curve expressed parametrically, that is, 2 = x(t), 


y = y(t). 


4.3.2.2 Transformations 


A transformation associates with each point (x, y) a different point in the same co- 
ordinate system; we denote this by 


(z,y) > F(z,y), (4.3.2) 


where F’ is a map from the plane to itself (a two-component function of two 
variables). For example, translating down by a distance d is accomplished by 
(x,y) + (a, y — d) (see Section 4.4). Thus, the action of the transformation on 
a point whose coordinates are known (or on a curve expressed parametrically) can 
be immediately computed. 

If, on the other hand, we have an object (say a curve) defined implicitly by the 
equation C(x, y) = 0, finding the equation of the transformed object requires using 
the inverse transformation 


(x,y) 4 G(a,y) (4.3.3) 


defined by G(F(x,y)) = (x,y) and F(G(a,y)) = (x,y). The equation of the 


transformed object is C(G(x, y)) = 0. For instance, if C' is the circle with equation 
x? +y? = 1 and we are translating down by a distance d, the inverse transformation 
is (x,y) +> (a, y + d) (translating up), and the equation of the translated circle is 


x? + (y +d)? = 1. Compare to the example following Equation (4.3.1). 





FIGURE 4.1 


Change of coordinates by a rotation. 
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4.3.2.3. Using transformations to perform changes of coordi- 
nates 


Usually, we will not give formulas of the form (4.3.1) for changes between two coor- 
dinate systems of the same type, because they can be immediately derived from the 
corresponding formulas (4.3.2) for transformations, which are given in Section 4.4. 
We give two examples for clarity. 

Let the two Cartesian coordinate systems (x, y) and (zx’, y’) be related as fol- 
lows: They have the same origin, and the positive x-axis is obtained from the pos- 
itive x-axis by a (counterclockwise) rotation through an angle @ (Figure 4.1). If a 
point has coordinates (x,y) in the unprimed system, its coordinates (x’, y’) in the 
primed system are the same as the coordinates in the unprimed system of a point that 
undergoes the inverse rotation, that is, a rotation by an angle a = —@. According to 
Equation (4.4.2) (page 200), this transformation acts as follows: 


cos@ sin@ 
—sin@ cosdé 


(x,y) > | | (x,y) = (acos0+ysin@, —xsin@+ycos@). (4.3.4) 
Therefore the right-hand side of Equation (4.3.4) is (~’, y’), and the desired substi- 


tution is 
xv’ = xcosé + ysind, 
; . (4.3.5) 
y = —axsiné+ ycosé. 
Switching the roles of the primed and unprimed systems, we get the equivalent 
substitution 
x =2' cosé—y’ sing, 
las / (4.3.6) 
y=ax sind+y cosé 
(because the x-axis is obtained from the x’ -axis by a rotation through an angle —6). 
Similarly, let the two Cartesian coordinate systems (x, y) and (x’, y’) differ by 
a translation: x is parallel to x’ and y to y’, and the origin of the second system 
coincides with the point (29, yo) of the first system. The coordinates (x, y) and 
(x’, y’) of a point are related by 


i / 
C= 2 +20; LG =2-2, 


; ; (4.3.7) 
y=y' + Yo; y' =Y—Yo- 





4.3.3 CARTESIAN COORDINATES IN THE PLANE 


In Cartesian coordinates (or rectangular coordinates), the “address” of a point P is 
given by two real numbers indicating the positions of the perpendicular projections 
from the point to two fixed, perpendicular, graduated lines, called the axes. If one 
coordinate is denoted x and the other y, the axes are called the x-axis and the y-axis, 
and we write P = (a,y). Usually the x-axis is horizontal, with x increasing to the 
right, and the y-axis is vertical, with y increasing vertically up. The point x = 0, 
y = 0, where the axes intersect, is the origin. See Figure 4.2. 
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FIGURE 4.2 

In Cartesian coordinates, Py = (4,3), P2 = (—1.3,2.5), P3 = (—1.5,-1.5), Pa = 
(3.5, —1), and Ps = (4.5,0). The axes divide the plane into four quadrants. P, is in the 
first quadrant, P2 in the second, P3 in the third, and P, in the fourth. Ps is on the positive 
x-axis. 


Py 











4.3.4 POLAR COORDINATES IN THE PLANE 


In polar coordinates a point P is also characterized by two numbers: the distance 
r > 0 to a fixed pole or origin O, and the angle @ that the ray OP makes with a fixed 
ray originating at O, which is generally drawn pointing to the right (this is called the 
initial ray). The angle @ is defined only up to a multiple of 360° or 27 radians. In 
addition, it is sometimes convenient to relax the condition r > 0 and allow r to bea 
signed distance, so (r, 0) and (—r, 6 + 180°) represent the same point (Figure 4.3). 


FIGURE 4.3 
Among the possible sets of polar coordinates for P are (10,30°), (10,390°) and 


(10, —330°). Among the sets of polar coordinates for Q are (2.5, 210°) and (—2.5, 30°). 
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4.3.4.1. Relations between Cartesian and polar coordinates 


Consider a system of polar coordinates and a system of Cartesian coordinates with 
the same origin. Assume that the initial ray of the polar coordinate system coincides 
with the positive x-axis, and that the ray 8 = 90° coincides with the positive y-axis. 
Then the polar coordinates (r,@) with r > 0 and the Cartesian coordinates (x, y) 
of the same point are related as follows (x and y are assumed positive for the 0 
definition): 


y 


x =rcosé, r=Vr+y, acim Jer ty? 
y=rsind, @=tan! 7 cos 6 = as 


4.3.5 HOMOGENEOUS COORDINATES IN THE PLANE 


A triple of real numbers (a : y : t), with t 4 0, is a set of homogeneous coordinates 
for the point P with Cartesian coordinates (/t, y/t). Thus the same point has many 
sets of homogeneous coordinates: (a : y : t) and (a’ : y’ : t’) represent the same 
point if and only if there is some real number a such that x’ = az, y’ = ay, 2/ = az. 

When we think of the same triple of numbers as the Cartesian coordinates of 
a point in three-dimensional space (page 249), we write it as (a, y,t) instead of 
(x : y : t). The connection between the point in space with Cartesian coordinates 
(x, y, t) and the point in the plane with homogeneous coordinates (a : y : t) becomes 
apparent when we consider the plane ¢ = 1 in space, with Cartesian coordinates 
given by the first two coordinates x, y of space (Figure 4.4). The point (a, y,¢) in 
space can be connected to the origin by a line L that intersects the plane t = 1 in the 
point with Cartesian coordinates (a/t, y/t) or homogeneous coordinates (x : y : t). 

Homogeneous coordinates are useful for several reasons. One the most impor- 
tant is that they allow one to unify all symmetries of the plane (as well as other 
transformations) under a single umbrella. All of these transformations can be re- 
garded as linear maps in the space of triples (a : y : t), and so can be expressed in 
terms of matrix multiplications (see page 201). 

If we consider triples (a : y : t) such that at least one of x, y,t is non-zero, 
we can name not only the points in the plane but also points “at infinity.” Thus, 
(x : y : 0) represents the point at infinity in the direction of the ray emanating from 
the origin going through the point (z, y). 








4.3.6 OBLIQUE COORDINATES IN THE PLANE 


The following generalization of Cartesian coordinates is sometimes useful. Consider 
two axes (graduated lines), intersecting at the origin but not necessarily perpendic- 
ularly. Let the angle between them be w. In this system of oblique coordinates, a 
point P is given by two real numbers indicating the positions of the projections from 
the point to each axis, in the direction of the other axis (see Figure 4.5). The first 
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FIGURE 4.4 


The point P with spatial coordinates (x, y, t) projects to the point Q with spatial coordinates 
(x/t, y/t, 1). The plane Cartesian coordinates of Q are (x/t, y/t), and (x : y : t) is one set 
of homogeneous coordinates for Q. Any point on the line L (except for the origin O) would 


also project to P’. 








axis (x-axis) is generally drawn horizontally. The case w = 90° yields a Cartesian 
coordinate system. 


FIGURE 4.5 
In oblique coordinates, P, = (4,3), Pz = (—1.3, 2.5), P3 = (—1.5,—-1.5), Ps = (3.5, —1), 
and Ps = (4.5, 0). Compare to Figure 4.2. 


Pj 











4.3.6.1 Relations between two oblique coordinate systems 


Let the two oblique coordinate systems (x,y) and (2’, y’), with angles w and w’, 
share the same origin, and suppose the positive x-axis makes an angle @ with the 
positive x-axis. The coordinates (x, y) and (x’, y’) of a point in the two systems are 
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related by 


_ a’ sin(w— 0) +y'sin(w —w' — 6) 


sin w 
_ a’ sind + y'sin(w’ + 8) 


(4.3.8) 


sinw 
This formula also covers passing from a Cartesian system to an oblique system and 
vice versa, by taking w = 90° or w’ = 90°. 
The relation between two oblique coordinate systems that differ by a translation 
is the same as for Cartesian systems. See Equation (4.3.7). 





4.4 PLANE SYMMETRIES OR ISOMETRIES 


A transformation of the plane (invertible map of the plane to itself) that preserves 
distances is called an isometry of the plane. Every isometry of the plane is of one of 
the following types: 


. The identity (which leaves every point fixed) 

. A translation by a vector v 

. A rotation through an angle a around a point P 

. A reflection in a line L 

. A glide-reflection in a line L with displacement d 


nABWN re 


4.4.1 SYMMETRIES: CARTESIAN COORDINATES 


In the formulas below, a multiplication between a matrix and a pair of coordinates 
should be carried out regarding the pair as a column vector (i.e., a matrix with two 
rows and one column). Thus [¢@ 5] (x,y) = (ax + by, cx + dy). 


1. Translation by (x0, yo): 


(x,y) > (@+ 20, y + Yo): (4.4.1) 
2. Rotation through a (counterclockwise) around the origin: 
cosa —sina 
(z,y) > i oe "| (x,y). (4.4.2) 


3. Rotation through a (counterclockwise) around an arbitrary point (29, yo): 


cosa —sina 
(2a) + (torte) + [8S SPC] (eto, y= wo) 43) 
4. Reflection: in the x-axis: (x,y) > (x, -y), 
in the y-axis: (x,y) + (—2, y), (4.4.4) 
in the diagonal x = y: (x,y) > (y, 2). 


5. Reflection in a line with equation az + by + c = 0: 


1 b?—a?— —2ab 
(x,y) Dae (| a | (x,y) — (2ac, 24) . (4.4.5) 
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6. Reflection in a line going through (2, yo) and making an angle a with the 
@-axis: 
cos 2a sin 2a 
(2.9) (eo. 40) + | 


sin2a —cos a (x — x0, y— yo). (4.4.6) 


7. Glide-reflection in a line L with displacement d: Apply first a reflection in L, 
then a translation by a vector of length d in the direction of L, that is, by the 
vector 1 

e+e! 
if L has equation az + by +c=0. 


tad, +bd) (4.4.7) 








4.4.2 SYMMETRIES: HOMOGENEOUS COORDINATES 


All isometries of the plane can be expressed in homogeneous coordinates in terms 
of multiplication by a matrix. This fact is useful in implementing these transforma- 
tions on a computer. It also means that the successive application of transformations 
reduces to matrix multiplication. The corresponding matrices are as follows: 


1. Translation by (x0, yo): 


1 0 XO 
Las a5) =]0 1 Yo} - (4.4.8) 
0 0 1 
2. Rotation through a around the origin: 
cosa —sina 0 
Ra = |sina cosa O]. (4.4.9) 
0 0 1 
3. Reflection in a line going through the origin and making an angle a with the 
a-axis: cos 2a sin2a 0 
My, = |sin2a —cos2a Oj]. (4.4.10) 
0 0 1 


From this, one can deduce all other transformations. 


EXAMPLE To find the matrix for a rotation through a around an arbitrary point 
P = (ao, yo), we apply a translation by —(xo, yo) to move P to the origin, a rotation 
through a around the origin, and then a translation by (0, yo): 


cosa —sina £0 — Xo cosa+ yosina 
T(x 9,yo) Ral (29 ,yo) = | Sina cosa Yo — Yocosa — Xo sina (4.4.11) 
0 0 1 


(Note the order of the multiplication.) 


4.4.3 SYMMETRIES: POLAR COORDINATES 


1. Rotation around the origin through an angle a: (r,0) 4 (r, 0+ a). 
2. Reflection in a line through the origin and making an angle a with the positive 
X-axis: (7,0) + (r, 2a — 6). 
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4.4.4 CRYSTALLOGRAPHIC GROUPS 


A group of symmetries of the plane that is doubly infinite is a wallpaper group, 
or crystallographic group. There are 17 types of such groups, corresponding to 17 
essentially distinct ways to tile the plane in a doubly periodical pattern. (There are 
also 230 three-dimensional crystallographic groups.) 


4.4.4.1 Crystallographic group classification 


To classify an image representing a crystallographic group, answer the following 
sequence of questions starting with: “What is the minimal rotational invariance?”. 


e None 
Is there a reflection? 
— No. 
Is there a glide-reflection? 
* No: pl 
* Yes: pg 
— Yes. 
Is there a glide-reflection in 
an axis that is not a reflection 
axis? 
* No: pm 
* Yes: cm 


e 2-fold (180° rotation); 
Is there a reflection? 
-— No. 
Is there a glide-reflection? 
* No: p2 
* Yes: pgg 
— Yes. 
Are there reflections in two di- 
rections? 
* No: pmg 
* Yes: Are all rotation cen- 
ters on reflection axes? 
No: cmm 


Yes: pmnm 


e 3-fold (120° rotation); 
Is there a reflection? 
— No: p3 
— Yes. 
Are all centers of threefold ro- 
tations on reflection axes? 


* No: p3lm 
* Yes: p3ml1 


e 4-fold (90° rotation); 
Is there a reflection? 
— No: p4 
— Yes. 
Are there four reflection axes? 


* No: p4g 
* Yes: p4m 


e 6-fold (60° rotation); 
Is there a reflection? 
— No: p6 
— Yes: pom 
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4.4.4.2 Crystallographic groups descriptions 


The simplest crystallographic group involves translations only (page 204, top left). 
The others involve, in addition to translations, one or more of the other types of 
symmetries (rotations, reflections, glide-reflections). The Conway notation for crys- 
tallographic groups is based on the types of non-translational symmetries occurring 
in the “simplest description” of the group: 


1. ° indicates a translations only, 

2. * indicates a reflection (mirror symmetry), 

3. * a glide-reflection, 

4. anumber n indicates a rotational symmetry of order n (rotation by 360°/n). 


In addition, if a number n comes after the *, the center of the corresponding rotation 
lies on mirror lines, so that the symmetry there is actually dihedral of order 2n. 

Thus the group ** has two inequivalent lines of mirror symmetry; the group 333 
has three inequivalent centers of order-3 rotation; the group 22* has two inequivalent 
centers of order-2 rotation as well as mirror lines; and *632 has points of dihedral 
symmetry of order 12 (= 2 x 6), 6, and 4. 

The table on page 204 gives the groups in the Conway notation and in the nota- 
tion traditional in crystallography. It also gives the quotient space of the plane by the 
action of the group. The entry “4,4,2 turnover” means the surface of a triangular puff 
pastry with corner angles 45°(= 180°/4), 45° and 90°. The entry “4,4,2 turnover 
slit along 2,4” means the same surface, slit along the edge joining a 45° vertex to 
the 90° vertex. Open edges are silvered (mirror lines); such edges occur exactly for 
those groups whose Conway notation includes a *. 

The last column of the table gives the dimension of the space of inequivalent 
groups of the given type (equivalent groups are those that can be obtained from one 
another by proportional scaling or rigid motion). For instance, there is a group of type 
° for every shape parallelogram, and there are two degrees of freedom for the choice 
of such a shape (say the ratio and angle between sides). Thus, the ° group is based 
on a square fundamental domain, while for the ° group a fundamental parallelogram 
would have the shape of two juxtaposed equilateral triangles. These two groups are 
inequivalent, although they are of the same type. 
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Quotient space 


Torus 

Klein bottle 

Cylinder 

Mobius strip 
Non-orientable football 
Open pillowcase 

Closed pillowcase 

4,4,2 turnover, slit along 4,4 
Square 

4,4,2 turnover 

4,4,2 turnover, slit along 4,2 
4,4,2 triangle 

3,3,3 turnover 

3,3,3 triangle 

6,3,2 turnover, slit along 3,2 
6,3,2 turnover 

6,3,2 triangle 





cooocoococoo or RFP NR RP RR rR eb 


The following figures show wallpaper patterns for each of the 17 types of crys- 
tallographic groups (two patterns are shown for the °, or translations-only, type). 
Thin lines bound unit cells, or fundamental domains. When solid, they represent 
lines of mirror symmetry, and are fully determined. When dashed, they represent ar- 
bitrary boundaries, which can be shifted so as to give different fundamental domains. 
Dots at the intersections of thin lines represent centers of rotational symmetry. 

Some of the relationships between the types are made obvious by the patterns. 
However, there are more relationships than can be indicated in a single set of pictures. 
For instance, there is a group of type ** hiding in any group of type 3*3. 
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4.5 OTHER TRANSFORMATIONS OF THE PLANE 


4.5.1 SIMILARITIES 


A transformation of the plane that preserves shapes is called a similarity. Every sim- 
ilarity of the plane is obtained by composing a proportional scaling transformation 
(also known as a homothety) with an isometry. A proportional scaling transformation 
centered at the origin has the form 


(x,y) > (ax, ay), (4.5.1) 


where a # 0 is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 


a 0 O 
H,=|0 a O|. (4.5.2) 
00 1 


In polar coordinates, the transformation is (7,0) +> (ar, 0). 


4.5.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an affine transformation. There are two important particular cases of such 
transformations: 


A non-proportional scaling transformation centered at the origin has the form 
(x,y) + (ax, by), where a,b 4 0 are the scaling factors (real numbers). The 
corresponding matrix in homogeneous coordinates is 


a 0 O 
Ha,» =|0 b Of]. (4.5.3) 
00 1 


A shear preserving horizontal lines has the form (2, y) +> (a + ry,y), where r 
is the shearing factor (see Figure 4.6). The corresponding matrix in homogeneous 
coordinates is 
1 r O 

S,=}0 1 Oj]. (4.5.4) 
0 0 1 
Every affine transformation is obtained by composing a scaling transformation with 
an isometry, or a shear with a homothety and an isometry. 
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FIGURE 4.6 
1 


A shear with factor r = 5. 


FIGURE 4.7 


A perspective transformation with center O, mapping the plane P to the plane Q. The trans- 
formation is not defined on the line L, where P intersects the plane parallel to Q and going 
through O. 




















4.5.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any plane projective transformation can be 
expressed by an invertible 3 x 3 matrix in homogeneous coordinates; conversely, 
any invertible 3 x 3 matrix defines a projective transformation of the plane. Projec- 
tive transformations (if not affine) are not defined on all of the plane but only on the 
complement of a line (the missing line is “mapped to infinity’). 

A common example of a projective transformation is given by a perspective 
transformation (Figure 4.7). Strictly speaking this gives a transformation from one 
plane to another, but, if we identify the two planes by (for example) fixing a Cartesian 
system in each, we get a projective transformation from the plane to itself. 
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4.6 LINES 


The (Cartesian) equation of a straight line is linear in the coordinates x and y: 
ax+by+c=0. (4.6.1) 


The slope of this line is —a/b, the intersection with the x-axis (or x-intercept) is 
x = —c/a, and the intersection with the y-axis (or y-intercept) is y = —c/b. If 
a = 0, the line is parallel to the x-axis, and if b = 0, then the line is parallel to the 
y-axis. 

(In an oblique coordinate system, everything in the preceding paragraph remains 
true, except for the value of the slope.) 

When a? + b? = 1 and c < 0 in the equation ax + by + c = 0, the equation 
is said to be in normal form. In this case —c is the distance of the line to the origin, 
and w (with cosw = a and sinw = Db) is the angle that the perpendicular dropped to 
the line from the origin makes with the positive z-axis (Figure 4.8, with p = —c). 

To reduce an arbitrary equation az + by + c = 0 to normal form, divide by 
+vVa? + b?, where the sign of the radical is chosen opposite the sign of c when 
c # 0 and the same as the sign of b when c = 0. 





4.6.1 LINES WITH PRESCRIBED PROPERTIES 


1. Line of slope m intersecting the x-axis at 7 = xo: y = m(a — Zo). 
2. Line of slope m intersecting the y-axis at y = yo: y = Max + Yo. 
3. Line intersecting the z-axis at x = xo and the y-axis at y = yo: 


— 4 1. (4.6.2) 


(This formula remains true in oblique coordinates.) 
4. Line of slope m passing through (0, yo): y — Yo = M(x — Xo). 
5. Line passing through points (9, yo) and (21, y1): 


= _ x y tl 
eS ae | Mi, ig DOs (4.6.3) 
f= Dy TQ — Ly tw Yt 1 


(These formulas remain true in oblique coordinates.) 
6. Slope of line going through points (xo, yo) and (x1, y1): ae 


7. Line passing through points with polar coordinates (ro, 60) anid on 01): 


r(ro sin(@ — 09) — 71 sin(@ — @1)) = rori sin(@1 — 00). (4.6.4) 
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FIGURE 4.8 


The normal form of the line L is x cosw + ysinw = p. 


y 








4.6.2 DISTANCES 


The distance between two points in the plane is the length of the line segment joining 
the two points. If the points have Cartesian coordinates (xo, yo) and (#1, y1), this 
distance is 


(z1 — 20)? + (yi — yo)?. (4.6.5) 


If the points have polar coordinates (19,99) and (11, 61), this distance is 


796 +17} — 2ror1 cos(A — 41). (4.6.6) 


If the points have oblique coordinates (xo, yo) and (21, y1), this distance is 


(x1 — 20)? + (y1 — yo)? + 2(a1 — 20) (y1 — Yo) Cosw, (4.6.7) 


where w is the angle between the axes (Figure 4.5). 
The point k% of the way from Po = (0, yo) to Py = (x1, y1) is 


k 100 —k ki 100 —k 
( wy Lae yi + (100 = (4.6.8) 


100 100 


(The same formula also works in oblique coordinates.) This point divides the seg- 
ment PoP in the ratio k : (100 — k). As a particular case, the midpoint of PoP, is 
given by (3(2o + Bi), 4+ (yo — y1)) : 

The distance from the point (20, yo) to the line ax + by + c = Ois 


axo + byp + ¢ 


4.6. 
Jar es 
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4.6.3 ANGLES 


The angle between two lines agxz + boy + co = O and ajax + byy + cy = Ois 


b —_ 
geet 28) tay 180 \ at fa) (4.6.10) 
ay ao aga, + boby 


In particular, the two lines are parallel when agb; = aybo, and perpendicular when 
aga, = —bob. 

The angle between two lines of slopes mo and m is tan~!(m,) — tan~ 1 (mo) 
(or tan~+((m 1 — mo)/(1 + momz))). In particular, the two lines are parallel when 
mo = mM, and perpendicular when mpm, = —1. 


4.6.4 CONCURRENCE AND COLLINEARITY 


Three lines agx + boy + co = 0, aya + biy +c, = 0, and agx + boy + co = 0 are 
concurrent (i.e., intersect at a single point) if and only if 


ay by cy) = 0. (4.6.11) 


(This remains true in oblique coordinates.) 
Three points (29, yo), (%1, y1) and (22, y2) are collinear (i.e., all three points 
are on a Straight line) if and only if 


ro yo 1 
Zz yy l=o. (4.6.12) 
Hosp) Y2 1 


(This remains true in oblique coordinates.) 
Three points with polar coordinates (79, 60), (71,01) and (r2, 62) are collinear 
if and only if 


r 172 sin(62 aaa 61) + Tory sin(61 = 4) + rero sin(49 = 02) = (0; (4.6.13) 





4.7 POLYGONS 


Given k > 3 points A;,..., A, in the plane, in a certain order, we obtain a k-sided 
polygon or k-gon by connecting each point to the next, and the last to the first, with 
a line segment. The points A; are the vertices and the segments A;A;+, are the 
sides or edges of the polygon. When /; = 3 we have a triangle, when k = 4 we 
have a quadrangle or quadrilateral, and so on (see page 218 for names of regular 
polygons). Here we assume that all polygons are simple: no consecutive edges are 
on the same line and no two edges intersect (except that consecutive edges intersect 
at the common vertex). 
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FIGURE 4.9 
Two simple quadrilaterals (left and middle) and one that is not simple (right). We will treat 


only simple polygons. 


Al 


A A 
. A3 Ag Ag 


As 


A A 
‘ Ag Aa Ag 


When we refer to the angle at a vertex A; we have in mind the interior angle 
(as marked in the leftmost polygon in Figure 4.9). We denote this angle by the same 
symbol as the vertex. The complement of A; is the exterior angle at that vertex; 
geometrically, it is the angle between one side and the extension of the adjacent side. 
In any k-gon, the sum of the angles equals 2(k — 2) right angles, or 2(k — 2) x 90°; 
for example, the sum of the angles of a triangle is 180°. 

The area of a polygon whose vertices A; have coordinates (2;, y;), for 1 <i< 
k, is the absolute value of 





area = $(@1y2 — F241) +++° + $(@e-1Yk — TeYk—1) + $ (Tey — Lik); 
k 
1 (4.7.1) 
=5 So (ziyiss — Lit1Yi) 
i=1 
where in the summation we take 7,41 = %1 and yg+1 = y1. For a triangle 
ry ys il 
area = $(r1y2 — xoy1 + Loy3 — X3Yy2 +. U3y1 — Z1y3) = 5 [2 1]. (4.7.2) 
xr y3 I 


In oblique coordinates with angle w between the axes, the area is as given above, 
multiplied by sin w. 
If the vertices have polar coordinates (r;,0;), for 1 < i < k, the area is the 


absolute value of 
k 


1 : 
area = 3 » TiTi4+l1 sin(O;41 aa 6), (4.7.3) 


where we take rp41 =r, and 6,41 = 6). 


4.7.1 TRIANGLES 


Because the angles of a triangle add up to 180°, at least two of them must be acute 
(less than 90°). In an acute triangle all angles are acute. A right triangle has one 
right angle, and an obtuse triangle has one obtuse angle. 

The altitude corresponding to a side is the perpendicular dropped to the line 
containing that side from the opposite vertex. The bisector of a vertex is the line 
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that divides the angle at that vertex into two equal parts. The median is the segment 
joining a vertex to the midpoint of the opposite side. See Figure 4.10. 

Every triangle also has an inscribed circle tangent to its sides and interior to 
the triangle (in other words, any three non-concurrent lines determine a circle). The 
center of this circle is the point of intersection of the bisectors. We denote the radius 
of the inscribed circle by r. 

Every triangle has a circumscribed circle going through its vertices; in other 
words, any three non-collinear points determine a circle. The point of intersection of 
the medians is the center of mass of the triangle (considered as an area in the plane). 
We denote the radius of the circumscribed circle by R. 

Introduce the following notations for an arbitrary triangle of vertices A, B, C 
and sides a, b, c (see Figure 4.10). Let h., t., and m, be the lengths of the altitude, 
bisector and median originating in vertex C, let r and R be as usual the radii of the 
inscribed and circumscribed circles, and let s be the semi-perimeter: s = 4 (at+b+tc). 

A triangle is equilateral if all of its sides have the same length, or, equivalently, 
if all of its angles are the same (and equal to 60°). It is isosceles if two sides are the 
same, or, equivalently, if two angles are the same. Otherwise it is scalene. 

For an equilateral triangle of side a we have 


area = 4a°V3, r= zav3, R= tav3, h= sav3, (4.7.4) 


where h is any altitude. The altitude, the bisector, and the median for each vertex 
coincide. 

For an isosceles triangle, the altitude for the unequal side is also the corre- 
sponding bisector and median, but this is not true for the other two altitudes. Many 
formulas for an isosceles triangle of sides a, a,c can be immediately derived from 
those for a right triangle whose legs are a and tc (see Figure 4.11, left). 

For a right triangle, the hypotenuse is the longest side and (opposite the right 
angle); the /egs are the two shorter sides (adjacent to the right angle). The altitude 
for each leg equals the other leg. In Figure 4.11 (right), h denotes the altitude for the 
hypotenuse, while m and n denote the segments into which this altitude divides the 
hypotenuse. 

The following formulas apply to a right triangle: 


A+ B= 90°, C=a4+t? (Pythagoras), 
_ ab Ra} 
~~ &+b+¢" ae 
a=csinA=ccosB, b=csin B =ccosA, 
me = b?, ne =a’, 
area = dab, he = ab, mn = h?. 


2 


The hypotenuse is a diameter of the circumscribed circle. The median joining 
the midpoint of the hypotenuse (the center of the circumscribed circle) to the right 
angle makes angles 2A and 2B with the hypotenuse. 
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FIGURE 4.10 


Notations for an arbitrary triangle of sides a, b, c and vertices A, B, C. The altitude cor- 
responding to C' is he, the median is m¢, the bisector is tc. The radius of the circumscribed 
circle is R, that of the inscribed circle is r. 




















A+B+C=180° 


c =a’? + b* —2abcosC (law of cosines), 
a=bcosC'+ ccosB, 
a b Cc 











: =- =- law of sines 
snA sinB  sinC ( f ), 














2 sin Asin B b 
area = thc = zabsinC = a =rs= _ 
= \/s(s — a)(s — b)(s —c) (Heron formula), 
bsinC 
r = esin(}A)sin(3B) sec(3C) = <= = (s — c) tan(3C), 
_ ( 1 a 1 4 1 )~ 
7 ha hy he , 
c abc 
R= = 
2sinC area’ 
h. =asinB = bsin A= a> 
c 
2ab C 
i aa a 
aie a (a+ bp)” an 


Me = \/ $@? + 4b? — 4c. 
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FIGURE 4.11 


Left: an isosceles triangle can be divided into two congruent right triangles. Right: notations 


for a right triangle. 



































a a 
c 
FIGURE 4.12 
Left: Ceva’s theorem. Right: Menelaus’s theorem. 
A A 
F Fy 
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Additional facts about triangles: 


1. In any triangle, the longest side is opposite the largest angle, and the shortest 
side is opposite the smallest angle. This follows from the law of sines. 

2. Ceva’s theorem (see Figure 4.12, left): In a triangle ABC, let D, FE, and F' be 
points on the lines BC’, C/A, and AB, respectively. Then the lines AD, BE, 
and C'F are concurrent if and only if the signed distances BD, CE, ... satisfy 


BD.CE.AF=DC.EA-FB. (4.7.5) 


This is so in three important particular cases: when the three lines are the 
medians, when they are the bisectors, and when they are the altitudes. 

3. Menelaus’s theorem (see Figure 4.12, right): In a triangle ABC, let D, EF’, and 
F be points on the lines BC, CA, and AB, respectively. Then D, FE, and F 
are collinear if and only if the signed distances BD, CE, ... satisfy 


BD.CE.AF=—-DC-EA-FB. (4.7.6) 
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4. Each side of a triangle is less than the sum of the other two. For any three 
lengths such that each is less than the sum of the other two, there is a triangle 
with these side lengths. 

5. Determining if a point is inside a triangle. 

Given a triangle’s vertices { Py, P;, P2} and the test point P3. Place Pp at the 
origin by subtracting its coordinates from each of the others. Then compute 
(here P; = (73,;)) 


a= X1Y2 — ©2Y1, 
b= 21y3 — ©3Y1, (4.7.7) 


C= L2Y3 — 3Ya. 
The point P3 is inside the triangle { Po, P,, P2} if and only if 


ab>0O and ac<0O and a(a—b+c)>0. (4.7.8) 


4.7.2 QUADRILATERALS 


The following formulas give the area of a general quadrilateral (see Figure 4.13, 
left, for the notation). 





area = $pqsin 0 = +(b* +d? — a? —c’) tand 
= av 4p*@? — (7 + d? — a? — ?)? (4.7.9) 


= \/(s—a)(s — b)(s — c)(s — d) — abcd cos? [$(A+C)]. 





FIGURE 4.13 
Left: notation for a general quadrilateral; in addition s = (a +b+c+d). Right: a 
parallelogram. 





Often, however, it is easiest to compute the area by dividing the quadrilateral into 
triangles. One can also divide the quadrilateral into triangles to compute one side 
given the other sides and angles, etc. 
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More formulas can be given for special cases of quadrilaterals. In a parallel- 
ogram, opposite sides are parallel and the diagonals intersect in the middle (Fig- 
ure 4.13, right). It follows that opposite sides have the same length and that two 
consecutive angles add up to 180°. In the notation of the figure, we have 


A=C, B=D, A+B=180°, 
h=asinA = asin B, area = bh, 


p= Va? +b? — 2abcos A, q= Va? +b? — 2abcos B. 


(All this follows from the triangle formulas applied to the triangles ABD and ABC.) 

From the last terms we obtain the “parallelogram law”: p? + q? = a? + b? or “the 

sums of the squares of the diagonals equals the sum of the squares of the sides”. 
Two particular cases of parallelograms are 


1. The rectangle, where all angles equal 90°. The diagonals of a rectangle 
have the same length. The general formulas for parallelograms reduce to 


h=a, area=ab, and p=q=va’?+b?. (4.7.10) 


2. The rhombus or diamond  , where adjacent sides have the same length (a = 
b). The diagonals of a rhombus are perpendicular. In addition to the general 
formulas for parallelograms, we have area = 4pq and p? + q? = 4a”. 


The square or regular quadrilateral is both a rectangle and a rhombus. 
A quadrilateral is a trapezoid if two sides are parallel. D Cc 


In the notation of the figure on the right we have 
A+D=B+C=180°, area= 5(AB+CD)h. 


The diagonals of a quadrilateral with consecutive sides a, b, 6, d are perpendic- 
ular if and only if a? + c? = b? + d?. 

A quadrilateral is cyclic if it can be inscribed in a circle, that is, if its four vertices 
belong to a single, circumscribed, circle. This is possible if and only if the sum of 
opposite angles is 180°. If F is the radius of the circumscribed circle, we have (in 
the notation of Figure 4.13, left) 


area = \/(s — a)(s — b)(s — c)(s — d) = $(ac + bd) sin9, 














_ (ac + bd)(ad + bc)(ab + cd) Guna 
AR 
(ac + bd) (ab + cd) 

- (ad + bc) , 

R- 1 /(ac+ bd)(ad + bc)(ab + cd) 
4\) (s — a)(s — b)(s — c)(s — d)’ 

a 2 area 

ac + bd’ 


pq=ac+bd (Ptolemy). 
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A quadrilateral is circumscribable if it has an inscribed circle (that is, a circle 
tangent to all four sides). Its area is rs, where r is the radius of the inscribed circle 
and s is as above. A quadrilateral is circumscribable if and only if a+c=b+d. 

For a quadrilateral that is both cyclic and circumscribable, we have the following 
additional equalities, where m is the distance between the centers of the inscribed 
and circumscribed circles: 


a+c=b4d, area = Vabcd = Ts, 
R= 1 /(ac+ bd)(ad + bc) (ab + cd) i 1 a 1 
4 abcd 7 2 (R-=m)2?  (R+m)2" 


4.7.3 REGULAR POLYGONS 


A polygon is regular if all its sides are equal and all its angles are equal. Either 
condition implies the other in the case of a triangle, but not in general. (A rhombus 
has equal sides but not necessarily equal angles, and a rectangle has equal angles but 
not necessarily equal sides.) 

For a k-sided regular polygon of side a, let @ be the angle at any vertex, and r 
and F the radii of the inscribed and circumscribed circles (r is called the apothem). 
As usual, let s = tka be the half-perimeter. Then 


k-2\ 
9 = (=) 180°, jo 
180° 180° \ 
k 














a= 2rtan = 2Rsin Eo 
area = +ka? cot fel = kr? tan = 
_ 8? : 360° 
aoe co = rs, 
Pr => 
R — 


Equilateral triangle 0.43301 a? | 0.28868 a | 0.57735 a 
Square a? | 0.50000 a | 0.70711 a 
Regular pentagon 1.72048 a? | 0.68819 a | 0.85065 a 
Regular hexagon 2.59808 a? | 0.86603 a a 
Regular heptagon 3.63391 a? | 1.03826 a | 1.152384 
Regular octagon 4.82843 a? | 1.20711 a | 1.30656 a 
Regular nonagon 6.18182 a? | 1.373744 | 1.461904 
Regular decagon 7.69421 a? | 1.53884 a | 1.61803 a 
Regular undecagon 9.36564 a? | 1.702844 | 1.774734 
Regular dodecagon 11.19625 a? | 1.86603 a | 1.93185 a 
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If ax, denotes the side of a k-sided regular polygon inscribed in a circle of radius R 


aon = \/2R? — Ry/4R? — a2. (4.7.11) 


If Aj, denotes the side of a k-sided regular polygon circumscribed about the same 


circle, 
2RA;, 


~ 2R+/4 + Ap 


an Ar /apAok 
Ag, = ——— , = 4/ —_-. 4.7.1 
2k = a a2k 5 ( 3) 


The areas 5x, Sox, S;, and S2;, of the same polygons satisfy 


2s0n8 
up ey ae.. See (4.7.14) 
Sop + Sk 


Avi (4.7.12) 


In particular, 





4.8 SURFACES OF REVOLUTION: THE TORUS 


A surface of revolution is formed by the rotation of a planar curve C’ about an axis in 
the plane of the curve and not cutting the curve. The Pappus—Guldinus theorem says 
that: 


1. The area of the surface of revolution on a curve C' is equal to the product of 
the length of C’ and the length of the path traced by the centroid of C' (which 
is 27 times the distance from this centroid to the axis of revolution). 

2. The volume bounded by the surface of revolution on a simple closed curve C 
is equal to the product of the area bounded by C and the length of the path 
traced by the centroid of the area bounded by C. 


When C is a circle, the surface obtained is a 
circular torus or torus of revolution. Let r be the 
radius of the revolving circle and let R be the 
distance from its center to the axis of rotation. 
The area of the torus is 47? Rr, and its volume is 
Qn? Rr?. 











4.9 QUADRICS 


A surface defined by an algebraic equation of degree two is called a quadric. 
Spheres, circular cylinders, and circular cones are quadrics. By means of a rigid 
motion, any quadric can be transformed into a quadric having one of the following 
equations (where a, b,c £ 0): 
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1. Real ellipsoid: x? /a? + y?/b? + 27/2 =1 
2. Imaginary ellipsoid: x? /a? +y?/b? + 27/2 =—-1 
3. Hyperboloid of one sheet: x? /a? + y?/b? — 27/2 =1 
4. Hyperboloid of two sheets: x? fa? + y7/b? — 22/c? = -1 
5. Real quadric cone: x /a? + y?/b? — 27/c? =0 
6. Imaginary quadric cone: x? /a? + y?/b? + 27/c? =0 
7. Elliptic paraboloid: x? /a? + y?/b? + 2z =0 
8. Hyperbolic paraboloid: x? /a? — y?/b? + 2z = 
9. Real elliptic cylinder: x? /a? + y?/b? =1 

10. Imaginary elliptic cylinder: x? /a? + y?/b? =—-1 

11. Hyperbolic cylinder: x /a? — y?/b? =1 

12. Real intersecting planes: a? /a? — y*/b? =0 

13. Imaginary intersecting planes: x /a? +y7/b? =0 

14. Parabolic cylinder: x? + 2y =0 

15. Real parallel planes: f= 

16. Imaginary parallel planes: g?=-1 

17. Coincident planes: xr? =0 


Surfaces with Equations 9-17 are cylinders over the plane curves of the same 
equation (Section 4.20). Equations 2, 6, 10, and 16 have no real solutions, so that 
they do not describe surfaces in real three-dimensional space. A surface with Equa- 
tion 5 can be regarded as a cone (Section 4.21) over a conic C' (any ellipse, parabola 
or hyperbola can be taken as the directrix; there is a two-parameter family of essen- 
tially distinct cones over it, determined by the position of the vertex with respect to 
C). The surfaces with Equations 1, 3, 4, 7, and 8 are shown in Figure 4.14. 

The surfaces with Equations 1-6 are central quadrics; in the form given, the 
center is at the origin. The quantities a, b, c are the semi-axes. 

The volume of the ellipsoid with semi-axes a, b,c is 4rabe. When two of the 
semi-axes are the same, we can also write the area of the ellipsoid in closed-form. 
Suppose b = c, so the ellipsoid x? /a? + (y? + 27)/b? = 1is the surface of revolution 
obtained by rotating the ellipse x? /a? + y?/b? = 1 around the x-axis. Its area is 


orazb fae 26 b+ Vb? — a? 
Ta . 1 VG = 2b? + log (4.9.1) 


=e Poa VE na 
The two quantities are equal, but only one avoids complex numbers, depending on 
whether a > b ora < b. Whena > b, we have a prolate spheroid, that is, an ellipse 
rotated around its major axis; when a < b we have an oblate spheroid, which is an 
ellipse rotated around its minor axis. 

Given a general quadratic equation in three variables, 


nb? + 


ax? + by? + cz* + 2fyz + 2gzx+ 2hay + 2px + 2%y+2rz+d=0, (4.9.2) 


one can determine the type of conic by consulting the table: 
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eT ox [ST signs [sigs [Type of quads 


Real ellipsoid 
same Imaginary ellipsoid 
opposite Hyperboloid of one sheet 
opposite Hyperboloid of two sheets 
opposite Real quadric cone 
same Imaginary quadric cone 
same Elliptic paraboloid 
opposite Hyperbolic paraboloid 
same opposite | Real elliptic cylinder 
same same Imaginary elliptic cylinder 
opposite Hyperbolic cylinder 
opposite Real intersecting planes 
same Imaginary intersecting planes 
Parabolic cylinder 
opposite | Real parallel planes 
same Imaginary parallel planes 


3 
eS) 
3 
3 
3 
3 
2 
2 
2 
2 
2 
2 
2 
1 
1 
1 
1 Coincident planes 


4 
4 
4 
4 
3 
3 
4 
4 
3 
3 
3 
2 
2, 
3 
2, 
2 
1 





The columns have the following meaning. Let 


ah gp 

ah gq bby 
e=|h b f and E= ie fe (4.9.3) 

a p qr d 


Let p3 and 4 be the ranks of e and F, and let A be the determinant of F. The 
column “k signs” refers to the non-zero eigenvalues of e, that is, the roots of 


a-—x h g 
h b-—«2 f | =9; (4.9.4) 
g f c-— 2x 
if all non-zero eigenvalues have the same sign, choose “same,” otherwise “opposite.” 
Similarly, “/¢ signs” refers to the sign of the non-zero eigenvalues of FE. 


4.9.1 SPHERES 


The set of points in space whose distance to a fixed point (the center) is a fixed 
positive number (the radius) is a sphere. A circle of radius r and center (0, yo, 20) 
is defined by the equation 


(x — 20)? + (y— yo)? + (2 — 2%)? =1”", (4.9.5) 





or 


av + y" + 27 — Qra9 — 2yyo — 2220 + x + Ye + a —-r?=0. (4.9.6) 
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FIGURE 4.14 
The five non-degenerate real quadrics. Top left: ellipsoid. Top right: hyperboloid of two 


sheets (one facing up and one facing down). Bottom left: elliptic paraboloid. Bottom middle: 


hyperboloid of one sheet. Bottom right: hyperbolic paraboloid. 





Conversely, an equation of the form 
ge +y? +274 Idx + 2ey+2fztg=0 (4.9.7) 


defines a sphere if d? + e? + f? > g; the center is (—d, —e, —f)) and the radius is 
Vd? +e? + f2 —g. 

1. Four points not in the same plane determine a unique sphere. If the points have 

coordinates (21, y1, 21), (@2, Ye, 22), (%3, ys, 23) and (v4, v4, 24), the equation 
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FIGURE 4.15 
Left: a spherical cap. Middle: a spherical zone (of two bases). Right: a spherical segment. 


Kw 





of the sphere is 








etyt+e2 2 y z 1 
x? + yi — ae 1% yy 24 id 
wz+¥3+23 2 yo 2 1]/=0 (4.9.8) 
azt+yg+23 @3 ys z3 1 
eit+yz+22 24. ys 2 1 








. Given two points P; = (x1, 41, 21) and P; = (x2, yo, 22), there is a unique 


sphere whose diameter is P; P2; its equation is 





(uw — #1)(@ — 2) + (y-m)(y — v2) + (Z- A)(z- 22) =0. (4.9.9) 


4,73 


. The area of a sphere of radius r is 4rr?, and the volume is 4rr°. 


3 


. The area of a spherical polygon (that is, of a polygon on the sphere whose 


sides are arcs of great circles) is 
— o2 6; —(n— 2)r) r, (4.9.10) 
i=1 


where r is the radius of the sphere, n is the number of vertices, and 6; are 
the internal angles of the polygons in radians. In particular, the sum of the 
angles of a spherical triangle is always greater than 7 = 180°, and the excess 
is proportional to the area. 


4.9.1.1 Spherical cap 


Let the radius be r (Figure 4.15, left). The area of the curved region is 27rh = rp”. 
The volume of the cap is $7h?(3r — h) = Emh(3a? + h?). 
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4.9.1.2 Spherical zone (of two bases) 


Let the radius be r (Figure 4.15, middle). The area of the curved region (called a 
spherical zone) is 2xrh. The volume of the zone is 47h(3a? + 3b? + h?). 


4.9.1.3 Spherical segment and lune 


Let the radius be r (Figure 4.15, right). The area of the curved region (called a 
spherical segment or lune) is 2r70, the angle being measured in radians. The volume 
of the segment is $730. 


4.9.1.4 Volume and area of spheres 


If the volume of an n-dimensional sphere of radius r is V,, (1) and its surface area is 
Sin(r), then 


Orr Dr 2pn gr 2pn 
V,(r) = ——Vp-2(r) ~ VT Tn\y n\j ? 
n n($) (3)! (4.9.11) 
n d 
Sn(r) ; V(r) = Gy Vn) 


Hence, the area of a circle is Vo = mr? & 3.1416r?, the volume of a 3-dimensional 
sphere is V3 = oar3 = 4.1888r%, the volume of a 4-dimensional sphere is Vz = 
tnt = 4.9348r+, the circumference of a circle is Sy = 27r, and the surface area 
of a sphere is S3 = 4rr?. 


For large values of n, 


nm (nt1)/2 


——.— (2re)*/2, (4.9.12) 
Vi 


Vi(r) & 





4.10 SPHERICAL GEOMETRY & TRIGONOMETRY 


The angles in a spherical triangle do not have to add up to 180 degrees. It is possible 
for a spherical triangle to have 3 right angles. 


4.10.1. RIGHT SPHERICAL TRIANGLES 


Let a, b, and c be the sides of a right spherical triangle with opposite angles A, B, 
and C’, respectively, where each side is measured by the angle subtended at the center 
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of the sphere. Assume that C' = 1/2 = 90° (see Figure 4.16, left). Then, 


sina = tanbcot B = sin Asinc, cos A = tan bcotc = cosasin B, 
sinb = tanacot A = sin Bsinc, cos B = tanacotc = cosbsin A, 


cosc = cos Acot B = cosacosb. 


FIGURE 4.16 
Right spherical triangle (left) and diagram for Napier’s rule (right). 


4.10.1.1 Napier’s rules of circular parts 


Arrange the five quantities a, b, co-A (this is the complement of A), co-c, co-B 
of a right spherical triangle with right angle at C, in cyclic order as pictured in 
Figure 4.16, right. If any one of these quantities is designated a middle part, then 
two of the other parts are adjacent to it, and the remaining two parts are opposite to 
it. The formulas above for a right spherical triangle may be recalled by the following 
two rules: 


1. The sine of any middle part is equal to the product of the tangents of the two 
adjacent parts. 

2. The sine of any middle part is equal to the product of the cosines of the two 
opposite parts. 


4.10.1.2 Rules for determining quadrant 


1. A leg and the angle opposite to it are always of the same quadrant. 
2. If the hypotenuse is less than 90°, the legs are of the same quadrant. 
3. If the hypotenuse is greater than 90°, the legs are not in different quadrants. 


4.10.2 OBLIQUE SPHERICAL TRIANGLES 
In the following: 


e a, b, c represent the sides of any spherical triangle. 
e A, B, C represent the corresponding opposite angles. 
e a,b’, c’, A’, B’, C’ are the corresponding parts of the polar triangle.! 





‘Given 3 vertices of a spherical triangle, the spherical triangle formed by connecting those 3 points 
with great circles is called the “‘polar triangle.” 
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es=(at+b+c)/2. 
© S=(A+B+C)/2. 
e A is the area of the spherical triangle. 
e Fis the spherical excess of the triangle. 
e fis the radius of the sphere upon which the triangle lies. 
0° <a+b+c< 360°, 180° < A+B+C < 540°, 
E=A+B+C-— 180°, A = rR? E/180. 
1 : 1 1 1 
tan qe = ,/tan 5 tan 3/8 —a) tan 5/8 — b) tan gis —c). 
A= 180° -a’, B=180° -U’, C = 180° —¢, 
a = 180° — A’, b= 180° — B’, c = 180° —C". 


4.10.2.1 Spherical law of sines 
sina _ sin b _ sinc 
snA sinB sinC’ 











4.10.2.2 Spherical law of cosines for sides 
cosa = cosbcosc+ sin bsinccos A, 


cos b = cosccosa + sincsinacos B, 





cosc = cosacosb+ sinasinbcosC. 


4.10.2.3 Spherical law of cosines for angles 


cos A = —cos BcosC' + sin BsinC cosa, 
cos B = —cosC cos A + sinC sin A cos b, 
cosC’ = — cos Acos B + sin Asin B cosc. 





4.10.2.4 Spherical law of tangents 


tan3(B—C)  tan3(b—c) tan3(C—A)  tan3(c—a) 
tand(B+C)  tan(b+c)’ tand(C +A) tand(c+a) 
tan3(A—B) _ tan$(a—b) 
tan 3(A + B) ~ tan 3(a +b) 








5] 
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4.10.2.5 Spherical half angle formulas 


sin(s — a) sin(s — b) sin(s — c) 


Define k? = . . Then 
sin s 

A k 

tan (= ) = ———_., 
2 sin(s — a) 
B k 

t — | = ——— 4.10.1 

sa ( 2 ) sin(s — b)’ ( ) 


4.10.2.6 Spherical half side formulas 


; = S 
Defi K2 =(t Bh as eee Th 
efine (tan R) cos($ — A) cos(S — B) cos(S — C) — 


~ 


tan(a/2) = K cos(S — A), 
tan(b/2) = K cos(S — B), (4.10.2) 
tan(c/2) = K cos(S' — C). 


4.10.2.7 Gauss’ formulas 


sin $(a — b) 2 sin $(A — B) cos (a — b) = sin $(A + B) 
sin tc COs 40 : cos tc cos 40 , 

sin $(a + 6) _ cos $(A — B) cos $(a + b) _ cos $(A + B) 
sin tc sin 40 ; cos tc sin 4C 


4.10.2.8 Napier’s analogs 


sin3(A—B)  tand(a—b) sin$(a—b) tan$(A—B) 
sin $(A + B) tan to sin $(a + 6) ~ cot$C 
cos$(A—B)  tand(a+b) cos$(a—b) tan$(A+B) 
cos $(A + B) tan to! cos $(a + b) 7 cot $C 








4.10.2.9 Rules for determining quadrant 


1.W@A>B>C,thna>b>c. 

2. A side (angle) which differs by more than 90° from another side (angle) is in 
the same quadrant as its opposite angle (side). 

3. Half the sum of any two sides and half the sum of the opposite angles are in 
the same quadrant. 
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4.10.2.10 Summary of solution of oblique spherical triangles 


HalFangle formulas 
Three angles Half-side formulas 


Two sides and | Napier’s analogies (to find sum and difference | Gauss’ 
included angle | of unknown angles); then law of sines (to find | formulas 


remaining side). 


Two angles and | Napier’s analogies (to find sum and difference | Gauss’ 
included side of unknown sides); then law of sines (to find formulas 


remaining angle). 


Two sides and__| Law of sines (to find an angle); then Napier’s_ | Gauss’ 
an opposite analogies (to find remaining angle and side). formulas 
angle Note the number of solutions. 

Two angles and | Law of sines (to find a side); then Napier’s Gauss’ 
an opposite side } analogies (to find remaining side and angle). formulas 


Note the number of solutions. 





4.10.2.11 Finding the distance between two points on the earth 
To find the distance between two points on the surface of a spherical earth, let point 
P, have a (latitude, longitude) of (¢1, 61) and point P2 have a (latitude, longitude) 
of (¢2, 92). Two different computational methods are as follows: 


1. Let A be the North pole and let B and C' be the points P, and P;. Then 


the spherical law of cosines gives the desired distance, a, on a sphere of unit 
radius: 
cos(a) = cos(b) cos(c) + sin(b) sin(c) cos(A) 


where the angle A is the difference in longitudes, and b and c are the angles of 
the points from the pole (i.e., 90°— latitude). Scale by Rg (the radius of the 
earth) to get the final answer. 


. In (x, y, Z) space (with +-z being the North pole) points P; and P2 are repre- 


sented as vectors from the center of the earth 
V1 = [Re cos(¢1) cos(#,) Re cos(¢1) sin((1) Rg sin(d1)] , 
v2 = [Re cos(¢2) cos(2) Re cos(¢2)sin(#2) Re sin(¢2)] . 


The angle between these vectors, a, is given by 


(4.10.3) 








= Vi°V2 _, Ya V2 
Ivillv2] = RG 


or cosa = 2tan~! \/b/(1 — b) where b = cos(¢1) cos(¢2) sin? (45%) + 


sin? (25%). The great circle distance between P; and Pz is then Raa. 








cos @ = cos(¢1) cos(¢2) cos(@1 — 62) +sin(¢1) sin(¢2) 


EXAMPLE The angle between Pyew York with (¢1 = 40.78°,01 = 73.97°) and Preijing 


with (¢2 = 39.93°, 02 = 243.58°) is a = 98.8°. Using Re = 6367 the great circle 
distance between New York and Beijing is about 11,000 km. 
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4.11 CONICS 


A conic (or conic section) is a plane curve that can be obtained by intersecting a right 
circular cone (page 265) with a plane that does not go through the vertex of the cone. 
There are three possibilities, depending on the relative positions of the cone and the 
plane (Figure 4.17). If no line of the cone is parallel to the plane, then the intersection 
is a closed curve, called an ellipse. If one line of the cone is parallel to the plane, 
the intersection is an open curve whose two ends are asymptotically parallel; this is 
called a parabola. Finally, there may be two lines in the cone parallel to the plane; 
the curve in this case has two open segments, and is called a hyperbola. 


FIGURE 4.17 


A section of a cone by a plane can yield an ellipse (left), a parabola (middle) or a hyperbola 
(right). 


SKY 


4.11.1. ALTERNATIVE CHARACTERIZATION 


Assume given a point F’ in the plane, a line d not going through F’,, and a positive 
real number e. The set of points P such that the distance PF is e times the distance 
from P to d (measured along a perpendicular) is a conic. We call F' the focus, d the 
directrix, and e the eccentricity of the conic. If e < 1 we have an ellipse, ife = la 
parabola, and if e > 1 a hyperbola (Figure 4.18). This construction gives all conics 
except the circle, which is a particular case of the ellipse according to the earlier 
definition (we can recover it by taking the limit e — 0). 

For any conic, a line perpendicular to d and passing through F is an axis of 
symmetry. The ellipse and the hyperbola have an additional axis of symmetry, per- 
pendicular to the first, so that there is an alternate focus and directrix, F’ and d’, 
obtained as the reflection of F' and d with respect to this axis. (By contrast, the focus 
and directrix are uniquely defined for a parabola.) 

The simplest analytic form for the ellipse and hyperbola is obtained when the 
two symmetry axes coincide with the coordinate axes. The ellipse in Figure 4.19 has 
equation 


eee ae (4.11.1) 
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FIGURE 4.18 


Definition of conics by means of the ratio (eccentricity) between the distance to a point and 
the distance to a line. On the left, e = .7; in the middle, e = 1; on the right, e = 2. 


d d d 
P P. P 
F F 


with b < a. The x-axis is the major axis, and the y-axis is the minor axis. These 
names are also applied to the segments, determined on the axes by the ellipse, and 
to the lengths of these segments: 2a for the major axis and 2b for the minor. The 
vertices are the intersections of the major axis with the ellipse and have coordinates 
(a, 0) and (—a, 0). The distance from the center to either focus is a? — b?, and the 
sum of the distances from a point in the ellipse to the foci is 2a. The Jatera recta 
(in the singular, /atus rectum) are the chords perpendicular to the major axis and 
going through the foci; their length is 2b?/a. The eccentricity is a2 — b?/a. All 
ellipses of the same eccentricity are similar; in other words, the shape of an ellipse 
depends only on the ratio b/a. The distance from the center to either directrix is 
a? //a? — b?. 
The hyperbola in Figure 4.20 has equation 


ee 2 ell, (4.11.2) 
FIGURE 4.19 


Ellipse with major semiaxis a and minor semiaxis b. Here b/a = 0.6. 


d’ (0, 6) d 


F' O (a, 0) 
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FIGURE 4.20 


Hyperbola with transverse semiaxis a and conjugate semiaxis b. Here b/a = 0.4. 

















The z-axis is the transverse axis, and the y-axis is the conjugate axis. The 
vertices are the intersections of the transverse axis with the hyperbola and have co- 
ordinates (a,0) and (—a,0). The segment thus determined, or its length 2a, is also 
called the transverse axis, while the length 2b is also called the conjugate axis. The 
distance from the center to either focus is a? + 62, and the difference between the 
distances from a point in the hyperbola to the foci is 2a. The /atera recta are the 
chords perpendicular to the transverse axis and going through the foci; their length 
is 2b?/a. The eccentricity is V/a? + b?/a. The distance from the center to either 
directrix is a? /\/a2 + b?. The legs of the hyperbola approach the asymptotes, lines 
of slope +b/a that cross at the center. 

All hyperbolas of the same eccentricity are similar; in other words, the shape 
of a hyperbola depends only on the ratio b/a. Unlike the case of the ellipse (where 
the major axis, containing the foci, is always longer than the minor axis), the two 
axes of a hyperbola can have arbitrary lengths. When they have the same length, so 
that a = b, the asymptotes are perpendicular, and e = 2, the hyperbola is called 
rectangular. 

The simplest analytic form for the parabola is obtained when the axis of sym- 
metry coincides with one coordinate axis, and the vertex (the intersection of the axis 
with the curve) is at the origin. y 

The equation of the parabola on the right is d 


y’ = 4az, (4.11.3) 


where a is the distance from the vertex to the focus, or, which 
is the same, from the vertex to the directrix. The /atus rectum 
is the chord perpendicular to the axis and going through the 
focus; its length is 4a. All parabolas are similar: they can be 
made identical by scaling, translation, and rotation. 





F = (a,0) 
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4.11.2 THE GENERAL QUADRATIC EQUATION 
The analytic equation for a conic in arbitrary position is the following: 
Az? + By? + Cry+ Dr + Ey+F =0, (4.11.4) 


where at least one of A, B, C is nonzero. To reduce this to one of the forms given 
previously, perform the following steps (note that the decisions are based on the most 
recent values of the coefficients, taken after all the transformations so far): 


1. If C ¥ 0, simultaneously perform the substitutions 7 +> qx + y and y > 


qy — x, where 
BH AY B-A 
q= (4*) +1 4+ : (4.11.5) 





C C 


Now C = 0. (This step corresponds to rotating and scaling about the origin.) 
2. If B = 0, interchange x and y. Now B ¥ 0. 
3. If E ¥ 0, perform the substitution y + y — $(E/B). (This corresponds to 
translating in the y direction.) Now E = 0. 
4. If A=0: 


(a) If D ¥ 0, perform the substitution 7 + x — (F'/D) (translation in the 
x direction), and divide the equation by B to get Equation (4.11.3). The 
conic is a parabola. 

(b) If D = 0, the equation gives a degenerate conic. If F' = 0, we have the 
line y = O with multiplicity two. If F’ < 0, we have two parallel lines 
y = +,/F/B. If F > 0 we have two imaginary lines; the equation has 
no solution within the real numbers. 


5. If AZ0: 


(a) If D # 0, perform the substitution x ++ x — $(D/A). Now D = 0. 
(This corresponds to translating in the x direction.) 
(b) If F' ¥ 0, divide the equation by F to get a form with F’ = 1. 

i. If A and B have opposite signs, the conic is a hyperbola; to get to 
Equation (4.11.2), interchange x and y, if necessary, so that A is 
positive; then make a = 1/VA and b = 1/VB. 

ii. If A and B are both positive, the conic is an ellipse; to get to Equa- 
tion (4.11.1), interchange x and y, if necessary, so that A < B, then 
make a = 1/VA and b = 1/VB. The circle is the particular case 
a=b. 





iii. If A and B are both negative, we have an imaginary ellipse; the 
equation has no solution in real numbers. 


(c) If F = 0, the equation again represents a degenerate conic: when A and 
B have different signs, we have a pair of lines y = +,/—B/Az, and, 
when they have the same sign, we get a point (the origin). 
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EXAMPLE Here is an example for clarity. Suppose the original equation is 


Ag” + y* — dry + 32 — 4y +1=0. (4.11.6) 





In step 1 we apply the substitutions 7 + 227+ y and y ++ 2y — x. This gives 
252° + 102 — 5y + 1 = 0. Next we interchange x and y (step 2) and get 25y” + 
10y — 5a + 1 = 0. Replacing y by y — + in step 3, we get 25y” — 5a = 0. Finally, in 
step - we divide the equation by 25, thus giving it the form of Equation (4.11.3) with 
a= x: We have reduced the conic to a parabola with vertex at the origin and focus 
at es ,0). To locate the features of the original curve, we work our way back along 
the chain of substitutions (recall the convention about substitutions and transformations 
from Section 4.3.2): 





Substitution yoy + —. nadie 
Vertex (0, 0) (0,-4) (—2,0) (— 2, —4) 
Poe a) (i—-3) (Be) (—35) 30) 


We conclude that the original curve, Equation (4.11.6), is a parabola with vertex 
(—2, —4) and focus (—5, 4). 


An alternative analysis of Equation (4.11.4) consists in forming the quantities 





A ic iD 
ae A 30 
gD 22 FF : (4.11.7) 
A iD B +45 
K=|,, ° | i. | I=A+B 
iD F if OF 








and finding the appropriate case in the following table, where an entry in parentheses 
indicates that the equation has no solution in real numbers: 


PAT [AIT] [type ofconie 


Hyperbola 
Parabola 

Ellipse 

(Imaginary ellipse) 


Intersecting lines 

Point 

Distinct parallel lines 
(Imaginary parallel lines) 
Coincident lines 





For the central conics (the ellipse, the hyperbola, intersecting lines, and the point), 
the center (29, yo) is the solution of the system of equations 


2Axr+Cy+D=0, 
Cz+2By+F=0, 





234 CHAPTER 4. GEOMETRY 


namely 


2BD—CE a (4.11.8) 


Cao (Soa Cl 4AB 
and the axes have slopes g and —1/gq, where q is given by Equation (4.11.5). (The 


value —1/q can be obtained from Equation (4.11.5) by simply placing a minus sign 
before the radical.) The length of the semiaxis with slope q is 


A 1 

ral where r = 5(A+ B+ y(B— A)? + C?); (4.11.9) 
r 

note that r is one of the eigenvalues of the matrix of which J is the determinant. To 

obtain the other semiaxis, take the other eigenvalue (change the sign of the radical in 

the expression of r just given). 


EXAMPLE Consider the equation 32? + 4ry — 2y? + 3a — 2y +7 = 0. We have 











6 4 3 

A= 4 2} = —596 40 
3 -—2 14 
6 4 

iol, A)=-1<0 


We conclude that this is a hyperbola. 


4.11.3. ADDITIONAL PROPERTIES OF ELLIPSES 


Let C be the ellipse with equation x?/a? + y?/b? = 1, with a > b, and let 
F, F’ = (4vVa? — b?,0) be its foci (see Figure 4.19). 





1. A parametric representation for C' is given (acos 4, bsin#) = (2, y) 


by (acos 0, bsin@). The area of the shaded 
sector on the right is sab tan! (¢ tan 0). 
The /ength of the arc from (a, 0) to the point 
(acos 0, bsin@) is 


0 [ Fame ma (Ee) -P(E-0)). 


where e is the eccentricity and F is an elliptic integral (see page 470). Setting 
@ = 27 results in 


area = mab, perimeter = 4a E(7/2,e). (4.11.10) 


Note the approximation: perimeter ~ 7 [3(a +b) — \/(8a+ b)(a+ 30)| 
2. Given an ellipse in the form Ax? + Bry + Cy? = 1, form the matrix D = 


Fe Paul Let the eigenvalues of D be {A1, A2} and let {v1, v2} be the 
corresponding unit eigenvectors (choose them orthogonal if A; = Az). Then 


the major and minor semiaxes are given by v; = ae and 
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T 21 
VM2  V4AC — B? 

(b) The ellipse has the parametric representation x(t) = cos(t)v; +sin(t)vo. 
(c) The rectangle with vertices (+v1, +v2) is tangent to the ellipse. 


(a) The area of the ellipse is 














1—¢ 20t 
3. A rational parametric representation for C' is given by | a The’ ao) F 
4. The polar equation for C’ in the usual polar coordinate system is 
ab 
= (4.11.11) 


V/a? sin? 6 + b? cos? 6 
With respect to a coordinate system with origin at a focus, the equation is 


l 
= 4.11.12 
. 1+ecos@ ( ) 





where | = b?/a is half the latus rectum. (Use the + sign for the focus with 
positive x-coordinate and the — sign for the focus with negative x-coordinate.) 

5. Let P be any point of C. The sum of the distances PF and PF” is constant 
and equal to 2a. 

6. Let P be any point of C. Then the rays PF’ and PF’ make the same angle 
with the tangent to C at P. Thus any light ray originating at F’ and reflected 
in the ellipse will go through F”. 

7. Let T be any line tangent to C. The product of the distances from F' and F” to 
T is constant and equals b?. 

8. Lahire’s theorem: Let D and D’ be fixed lines in the plane, and consider a third 
moving line on which three points P, P’ and P” are marked. If we constrain 
P to lie in D and P’ to lie in D’, then P” describes an ellipse. 


4.11.4 ADDITIONAL PROPERTIES OF HYPERBOLAS 
Let C be the hyperbola with equation x? /a? — y?/b? = 1, and let 


FF’ = (+a? + b?,0) (4.11.13) 


be its foci (see Figure 4.20). The conjugate hyperbola of C is the hyperbola C’ with 
equation —x?/a? + y?/b? = 1. It has the same asymptotes as C, the same axes 
(transverse and conjugate axes being interchanged), and its eccentricity e’ is related 
to that of C by e’* +e72 = 1, 
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1. A parametric representation for C is , \ / 





given by (asec, btan@). A paramet- \ 
ric representation, which gives one branch \ > 
only, is (acosh 6, bsinh@). The area of 
the shaded sector on the right is 


ff (acosh6, bsinh 0) 


zab0 = zabcosh™* (x/a) ral 


r+Va* —a? / 
; 


= tablog 


where = acosh@. The length of the arc from (a,0) to the point 
(acosh@, bsinh @) is given by the elliptic integral 


: a | 262 42 
af Ve? cosh? ¢ — 1d¢ = —bi B (63, <) =a ee ge 
0 b 1 


&? — a? 


where e is the eccentricity andi = //—1. 


. A rational parametric representation for C is given by 


( 1+¢ 2bt ) (4.11.14) 
asa Tp): v1. 
. The polar equation for C in the usual polar coordinate system is 
b 
er (4.11.15) 
v/a? sin? 6 — b? cos? 6 
With respect to a system with origin at a focus, the equation is 
l 
r= —————_. (4.11.16) 





1+ecos@’ 


where | = b?/a is half the latus rectum. (Use the — sign for the focus with 
positive x-coordinate and the + sign for the focus with negative «-coordinate.) 


. Let P be any point of C. The unsigned difference between the distances PF 


and PF” is constant and equal to 2a. 


. Let P be any point of C. Then the rays PF’ and PF” make the same angle 


with the tangent to C at P. Thus any light ray originating at F’ and reflected 
in the hyperbola will appear to emanate from F”. 


. Let T be any line tangent to C. The product of the distances from F' and F” to 


T is constant and equals b?. 


. Let P be any point of C. The area of the parallelogram formed by the asymp- 


totes and the parallels to the asymptotes going through P is constant and equals 
1 

sab. 

5a 


. Let L be any line in the plane. If L intersects C' at P and P’ and intersects 


the asymptotes at Q and Q’, the distances PQ and P’Q’ are the same. If L 
is tangent to C we have P = P’, so that the point of tangency bisects the 


segment QQ’. 
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4.11.5 ADDITIONAL PROPERTIES OF PARABOLAS 


Let C be the parabola with equation y? = 4az, and let F = (a,0) be its focus. 


1. Let P = (x,y) and P’ = (a’,y’) be points on C. The area bounded by the 
chord PP’ and the corresponding arc of the parabola is 


ly’ — yl? 


4.11.17 
24a ( ) 


It equals four-thirds of the area of the triangle PQ P’, where Q is the point on 
C whose tangent is parallel to the chord PP’ (formula due to Archimedes). 
2. The length of the arc from (0, 0) to the point (a, y) is 


2 2 2: 4 2 
a \44+ 4 +asinh" (4) = tiie Apigg@ VE 
4 a? 2a 4 a? 2a 





(4.11.18) 
3. The polar equation for C in the usual polar coordinate system is 
4a cos 0 
r= : 4.11.19 
sin? 0 ‘ 


With respect to a coordinate system with origin at F’, the equation is 


l 


aa 1—cos6’ 


(4.11.20) 


where | = 2a is half the latus rectum. 

4. Let P be any point of C’. Then the ray PF and the horizontal line through P 
make the same angle with the tangent to C' at P. Thus light rays parallel to the 
axis and reflected in the parabola converge onto F' (principle of the parabolic 
reflector). 


4.11.6 CIRCLES 


The set of points in a plane whose distance to a fixed point (the center) is a fixed 
positive number (the radius) is a circle. A circle of radius r and center (29, yo) is 
described by the equation 


(e — 20)” + (y— yo)? =r", Galen 


or 


Conversely, an equation of the form 
x? + y* + 2dx + 2ey+ f =0 (4.11.23) 


defines a circle if d? + e? > f; the center is (—d, —e) and the radius is 
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Three points not on the same line determine a unique circle. If the points have 
coordinates (21, y1), (2, y2) and (x3, y3), then the equation of the circle is 


e+ y? ur sYy 
2 2 
Try, 1 Yi 


LT UL =0. (4.11.24) 


vy YB v2 Y2 
TTY3 «©3 Y3 


aa 





A chord of a circle is a line segment between two of its points (Figure 4.21). 
A diameter is a chord that goes through the center, or the length of such a chord 
(therefore the diameter is twice the radius). Given two points P,; = (x1, yi) and 
Pz = (x2, y2), there is a unique circle whose diameter is P; P2; its equation is 


(x — 21)(a — 22) + (y— y1)(y — y2) = 0. (4.11.25) 


The length or circumference of a circle of radius r is 27r, and the area is rr?. 


The length of the arc of circle subtended by an angle 0, shown as s in Figure 4.21, is 
r@. (All angles are measured in radians.) Other relations between the radius, the arc 
length, the chord, and the areas of the corresponding sector and segment are, in the 
notation of Figure 4.21, 


d= Reos46 = $ccot $0 = 4V/4R? - c?, 
c= 2Rsin 50 = 2dtan 50 = 2 R? — d? = \/4h(2R — hi), 


: d 0 
d= z =2cos"! Ro 2tan + = = 2sin7! on 
area of sector = i Rs = £R0, 
area of segment = 4R°(0 — sin@) = $(Rs — cd) = R? cos~! = — dy R? — d? 


FIGURE 4.21 


The arc of a circle subtended by the angle @ is s; the chord is c; the sector is the whole slice of 
the pie; the segment is the cap bounded by the arc and the chord (that is, the slice minus the 
triangle). 
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FIGURE 4.22 
Left: the angle ACB equals 30 for any C in the long arc AB; ADB equals 180° — 30 for 


any D in the short arc AB. Right: the locus of points, from which the segment AB subtends 


a fixed angle 0, is an arc of the circle. 











Other properties of circles: 


1. 


If the central angle AOB equals 0, the angle ACB, where C is any point on 
the circle, equals 40 or 180° — 40 (Figure 4.22, left). Conversely, given a 
segment AB, the set of points that “see” AB under a fixed angle is an arc of a 
circle (Figure 4.22, right). In particular, the set of points that see AB under a 
right angle is a circle with diameter AB. 


. Let P,, Po, P3, Py be points in the plane, and let d;;, for 1 < i,7 < 4, be the 


distance between P; and P;. A necessary and sufficient condition for all of the 
points to lie on the same circle (or line) is that one of the following equalities 
be satisfied: 





dy2d34 + di3do4 £ di4do3 = 0. (4.11.26) 











This is equivalent to Ptolemy’s formula for cyclic quadrilaterals (page 217). 


. In oblique coordinates with angle w, a circle of center (9, yo) and radius r is 


described by the equation 


(x — 29)? + (y — yo)? + 2(x — 20) (y — yo) cosw = r?. (4.11.27) 





. In polar coordinates, the equation for a circle centered at the pole and having 


radius a is r = a. The equation for a circle of radius a passing through the 
pole and with center at the point (1,0) = (a, 4) is r = 2acos(@ — 09). The 
equation for a circle of radius a and with center at the point (7,0) = (10, 90) 


r? — 2ror cos(O — 09) + rg — a? = 0. (4.11.28) 


. Ifa line intersects a circle of center O at points A and B, the segments OA 


and OB make equal angles with the line. In particular, a tangent line is per- 
pendicular to the radius that goes through the point of tangency. 


. Fix a circle and a point P in the plane, and consider a line through P that 


intersects the circle at A and B (with A = B fora tangent). Then the product 
of the distances PA - PB is the same for all such lines. It is called the power 
of P with respect to the circle. 
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4.12 SPECIAL PLANE CURVES 


4.12.1 ALGEBRAIC CURVES 


Curves that can be given in implicit form as f(x,y) = 0, where f is a polynomial, 
are called algebraic. The degree of f is called the degree or order of the curve. Thus, 
conics (page 229) are algebraic curves of degree two. Curves of degree three already 
have a great variety of shapes, and only a few common ones will be given here. 

The simplest case is the curve which is a graph of a polynomial of degree three: 
y = ax® + bx? + cx + d, with a # 0. This curve is a (general) cubic parabola 
(Figure 4.23), symmetric with respect to the point B where x = —b/3a. 

The equation of a semi-cubic parabola (Figure 4.24, left) is y2 = kx; by pro- 
portional scaling one can take k = 1. This curve should not be confused with the 
cissoid of Diocles (Figure 4.24, middle), whose equation is (a — x)y? = x° with 


a#0. 
FIGURE 4.23 


The general cubic parabola for a > 0. For a < 0, reflect in a horizontal line. 


wo 2 


b? > 3ac = 3ac 2 < Bac 


FIGURE 4.24 


The semi-cubic parabola, the cissoid of Diocles, and the witch of Agnesi. 


diameter a 
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The latter is asymptotic to the line « = a, whereas the semi-cubic parabola has 
no asymptotes. The cissoid’s points are characterized by the equality OP = AB in 
Figure 4.24, middle. One can take a = | by proportional scaling. 

More generally, any curve of degree three with equation (2 — r9)y? = f(z), 
where f is a polynomial, is symmetric with respect to the x-axis and asymptotic 
to the line x = zg. In addition to the cissoid, the following particular cases are 
important: 


1. The witch of Agnesi has equation ry? = a?(a — x), with a # 0, and is 
characterized by the geometric construction shown in Figure 4.24, right. This 
construction provides the parametric representation x = acos? 6, y = atan0. 
Once more, proportional scaling reduces to the case a = 1. 

2. The folium of Descartes (Figure 4.25, left) is described by equation (a — 
ajy? = —«?(4x2 + a), with a 4 0 (reducible to a = 1 by proportional 
scaling). By rotating 135° (right) we get the alternative and more familiar 
equation 2° + y*® = cry, where c = 4\/2a. The folium of Descartes is a 
rational curve, that is, it is parametrically represented by rational functions. In 
the tilted position, the equation is z = ct/(1 + t?), y = ct?/(1 + #9) (so that 
t= y/z). 

3. The strophoid’s equation is (x — a)y” = —x*(x + a), with a 4 0 (reducible 
to a = 1 by proportional scaling). It satisfies the property AP = AP’ = OA 
in Figure 4.25, right; this means that POP’ is a right angle. The strophoid’s 
polar representation is 7 = —acos 20 sec 6, and the rational parametric repre- 
sentation is x = a(t? —1)/(t? +1), y = at(t? — 1)/(t? +1) (so that t = y/z). 


FIGURE 4.25 


The folium of Descartes in two positions, and the strophoid. 











CaS 7 




















Among the important curves of degree four are the following: 


1. A Cassini’s oval is characterized by the following condition: Given two foci 
F and F’, a distance 2a apart, a point P belongs to the curve if the product of 
the distances PF and PF’ is a constant k?. If the foci are on the x-axis and 
equidistant from the origin, the curve’s equation is (x? + y? +a”)? — 4a?2? = 
k*. Changes in a correspond to rescaling, while the value of k/a controls 
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FIGURE 4.26 

Cassini’s ovals for k = 0.5a, 0.9a, a, 1.1a and 1.5a (from the inside to the outside). The 
foci (dots) are at x = a and x = —a. The black curve, k = a, is also called Bernoulli’s 
lemniscate. 








the shape: the curve has one smooth segment and one with a self-intersection, 
or two segments depending on whether k is greater than, equal to, or smaller 
than a (Figure 4.26). The case k = a is also known as the lemniscate (of Jakob 
Bernoulli); the equation reduces to (x? + y”)? = a?(x? — y?), and upon a 45° 
rotation to (a? + y?)? = 2a?xy. Each Cassini’s oval is the section of a torus 
of revolution by a plane parallel to the axis of revolution. 


2. A conchoid of Nichomedes is the set of points such that the signed distance 
AP in Figure 4.27, left, equals a fixed real number k (the line L and the origin 
O being fixed). If L is the line « = a, the conchoid’s polar equation is r = 
asec@+k. Once more, a is a scaling parameter, and the value of k/a controls 
the shape: when & > —a the curve is smooth, when k = —a there is a cusp, 
and when k < —a there is a self-intersection. The curves for & and —k can 
also be considered two leaves of the same conchoid, with Cartesian equation 
(2 — a)?(x? + y?) = kx. 


3. A limacgon of Pascal is the set of points such that the distance AP in Fig- 
ure 4.28, left, equals a fixed positive number / measured on either side (the 
circle C' and the origin O being fixed). If C’ has diameter a and center at 
(0, 4a), the limacgon’s polar equation is r = acos@ + k, and its Cartesian 
equation is 

(a? + y? — az)? = k*(2? +-y”). (4.12.1) 
The value of k/a controls the shape, and there are two particularly interesting 
cases. For k = a, we get a cardioid (see also page 245). For a = tk, we get 
a curve that can be used to frisect an arbitrary angle a. If we draw a line L 
through the center of the circle C making an angle a with the positive x-axis, 
and if we call P the intersection of Z with the limacgon a = 4k, the line from 
O to P makes an angle with L equal to $a. 


Hypocycloids and epicycloids with rational ratios (see next section) are also 
algebraic curves, generally of higher degree. 
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FIGURE 4.27 
Defining property of the conchoid of Nichomedes (left), and curves for k = +0.5a, k = a, 


and k = +1.5a (right). 
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FIGURE 4.28 
Defining property of the limagon of Pascal (left), and curves for k = 1.5a, k = a, and 


k = 0.5a (right). The middle curve is the cardioid; the one on the right a trisectrix. 


0) © 





FIGURE 4.29 
Cycloid (top) and trochoids with k = 0.5a and k = 1.6a, where k is the distance PQ from 


the center of the rolling circle to the pole. 
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4.12.2 ROULETTES (SPIROGRAPH CURVES) 


Suppose given a fixed curve C and a moving curve M/, which rolls on C’ without 
slipping. The curve drawn by a point P kept fixed with respect to M is called a 
roulette, of which P is the pole. 

The most important examples of roulettes arise when M is a circle and C is 
a straight line or a circle, but an interesting additional example is provided by the 
catenary y = acosh(x/a), which arises by rolling the parabola y = x?/(4a) on the 
x-axis with pole the focus of the parabola (that is, P = (0, a) in the initial position). 
The catenary is the shape taken under the action of gravity by a chain or string of 
uniform density whose ends are held in the air. 

A circle rolling on a straight line gives a trochoid, with the cycloid as a special 
case when the pole P lies on the circle (Figure 4.29). If the moving circle 1/7 has 
radius a and the distance from the pole P to the center of / is k, the trochoid’s 
parametric equation is 


x=ap—ksing, y =a—kcos@. (4.12.2) 
The cycloid, therefore, has the parametric equation 
x =a(d—sin@), y = a(1—cos@). (4.12.3) 


One can eliminate ¢ to get x as a (multivalued) function of y, which takes the fol- 
lowing form for the cycloid: 


eat («cos-! (<<) - vay) (4.12.4) 


The length of one arch of the cycloid is 8a, and the area under the arch is 37a”. 








FIGURE 4.30 


Left: initial configuration for epitrochoid (black) and configuration at parameter value 0 


(gray). Middle: epicycloid with b = sa (nephroid). Right: epicycloid with b = a (cardioid). 


Se 


A trochoid is also called a curtate cycloid when k < a (that is, when P is inside 
the circle) and a prolate cycloid when k > a. 
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A circle rolling on another circle and exterior to it gives an epitrochoid. If a is 
the radius of the fixed circle, b that of the rolling circle, and k is the distance from P 
to the center of the rolling circle, the parametric equation of the epitrochoid is 


x = (a+b) cosé — kcos((1+ a/b)6), y = (a+b) siné — ksin((1 + a/b)0). 


These equations assume that, at the start, everything is aligned along the positive 
x-axis, as in Figure 4.30, left. Usually one considers the case when a/b is a rational 
number, say a/b = p/q where p and q are relatively prime. Then the rolling circle 
returns to its original position after rotating g times around the fixed circle, and the 
epitrochoid is a closed curve—in fact, an algebraic curve. One also usually takes 
k; = b, so that P lies on the rolling circle; the curve in this case is called an epicycloid. 
The middle diagram in Figure 4.30 shows the case b = k = 4a, called the nephroid; 
this curve is the cross-section of the caustic of a spherical mirror. The diagram on the 
right shows the case b = k = a, which gives the cardioid (compare to Figure 4.28, 
middle). 

Hypotrochoids and hypocycloids are defined in the same way as epitrochoids and 
epicycloids, but the rolling circle is inside the fixed one. The parametric equation of 
the hypotrochoid is 


x = (a— b)cos6 + kcos((a/b — 1)6), y = (a — b) sin — ksin((a/b — 1)8), 


where the letters have the same meaning as for the epitrochoid. Usually one takes 
a/b rational and k = b. There are several interesting particular cases: 


e b=k =a gives a point. 

eb=k= 30 gives a diameter of the circle C’. 

e b=k = ga gives the deltoid (Figure 4.31, left), whose algebraic equation is 
(a? + y*)? — 8aa3 + 24any? + 1807(2? + y*)-— 27a = 0. (4.12.5) 


eb=k= ta gives the astroid (Figure 4.31, right), an algebraic curve of de- 
gree six whose equation can be reduced to g2/3 4 y?/ 3 — q?/3, The figure 
illustrates another property of the astroid: its tangent intersects the coordinate 
axes at points that are always the same distance a apart. Otherwise said, the 
astroid is the envelope of a moving segment of fixed length whose endpoints 
are constrained to lie on the two coordinate axes. 


4.12.3 CURVES IN POLAR COORDINATES 


polar equation type of curve 

r=a circle 

r =acosé circle 

r=asiné circle 

r2 — 2br cos(# — 8) + (b? — a?) =0 circle at (b, 3) of radius a 
k e=1 parabola 

i= aaa O0O<e<1_ ellipse 


e>1 hyperbola 
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FIGURE 4.31 
The hypocycloids with a = 3b (deltoid) and a = 4b (astroid). 


AS 
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A number of interesting curves have polar equation r = f(0), where f is a mono- 
tonic function (always increasing or decreasing). This property leads to a spiral 
shape. The logarithmic spiral or Bernoulli spiral (Figure 4.12.4, left) is self-similar: 
by rotation the curve can be made to match any scaled copy of itself. Its equation 
is r = ke%; the angle between the radius from the origin and the tangent to the 
curve is constant and equal to @ = cot~!a. A curve parameterized by arc length 
and such that the radius of curvature is proportional to the parameter at each point is 
a Bernoulli spiral. 


(OO e 


FIGURE 4.32 


The Bernoulli or logarithmic spiral (left), the Archimedes or linear spiral (middle), and the 
Cornu spiral (right). 


In the Archimedean spiral or linear spiral (Figure 4.12.4, middle), the spacing 
between intersections along a ray from the origin is constant. The equation of this 
spiral is r = a6; by scaling one can take a = 1. It has an inner endpoint, in contrast 
with the logarithmic spiral, which spirals down to the origin without reaching it. The 
Cornu spiral or clothoid (Figure 4.12.4, right), important in optics and engineering, 
has the following parametric representation in Cartesian coordinates: 


t t 
X =aC(t) = af cos(4$78”) ds, y =aS(t) = af sin(}7s”) ds. 
0 0 


(C and S are the so-called Fresnel integrals; see page 476). A curve parameterized 
by arc length and such that the radius of curvature is inversely proportional to the 
parameter at each point is a Cornu spiral (compare to the Bernoulli spiral). 
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4.12.5 THE PEANO CURVE AND FRACTAL CURVES 


There are curves (in the sense of continuous maps from the real line to the plane) 
that completely cover a two-dimensional region of the plane. We give a construction 
of such a Peano curve, adapted from David Hilbert’s example. The construction 
is inductive and is based on replacement rules. We consider building blocks of six 


shapes: rae ( ae q——_. the length of the straight segments being twice 
the radius of the curved ones. A sequence of these patterns, end-to-end, represents a 
curve, if we disregard the gray and black half-disks. The replacement rules are the 
following: 


Cf © Bi 
i + ¢ & | 
q ft ty} Per at 


The rules are applied taking into account the way each piece is turned. Here we 
apply the replacement rules to a particular initial pattern: 


ae 
a 


| 
LY 


(We scale the result so it has the same size as the original.) Applying the process 
repeatedly gives, in the limit, the Peano curve. Note that the sequence converges 
uniformly and thus the limit function is continuous. Here are the first five steps: 


OU se i 


The same idea of replacement rules leads to many interesting fractal, and often 
self-similar, curves. For example, the substitution _, —/\_ leads to the 
Koch snowflake when applied to an initial equilateral triangle, like this (the first three 
stages and the sixth are shown): 











248 CHAPTER 4. GEOMETRY 








3 


Given an object X, if n(e€) open sets of diameter of € are required to cover X, then 
the capacity dimension of X is 





(4.12.6) 


capacity = lim 
€ 


indicating that n(e) scales as €4 


Object Dimension 


Logistic equation Sierpinski sieve 


Cantor set pe = 0. 6309 Pentaflake 


capecity The capacity dimension of various objects: 


Koch snowflake ape © 1.2619 || Sierpiriski carpet 


Cantor dust — ~ 1.4650 |} Tetrix 2 


Minkowski sausage 3 = 1.5 || Menger sponge 2n2+In5 ~, 2.7268 











The logistic equation is in section 3.5.7.3. 
The Cantor set Cx, is obtained by starting with the unit interval Co = [0,1] 
and sequentially removing the open middle third. Hence, C) = [0, 4] U [3 1] and 


C2 = [0,5] U [5,3] Y [35] U [5.4 


4.12.7 CLASSICAL CONSTRUCTIONS 


The ancient Greeks used straightedges and compasses to find the solutions to numer- 
ical problems. For example, they found square roots by constructing the geometric 
mean of two segments. Three famous problems that cannot be solved this way are: 


1. The trisection of an arbitrary angle. 

2. The squaring of the circle (the construction of a square whose area is equal to 
that of a given circle). 

3. The doubling of the cube (the construction of a cube with double the volume 
of a given cube). 


A regular n-gon inscribed in the unit circle can be constructed by straightedge 
and compass alone if and only if n has the form n = 2°p,p2...pz, where £ is a 
nonnegative integer and {;} are distinct Fermat primes (primes of the form 2?” +1). 
The only known Fermat primes are for 3, 5, 17, 257, and 65537, corresponding to 
m = 1,2,3,4. Thus, regular n-gons can be constructed with this many sides n = 3, 
4,5, 6, 8, 10, 12, 15, 16, 17, 20, 24, ..., 257,.... 
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4.13 COORDINATE SYSTEMS IN SPACE 


4.13.1. CONVENTIONS 


When we talk about “the point with coordinates (a, y, z)” or “the surface with equa- 
tion f(a, y, z),” we always mean Cartesian coordinates. If a formula involves another 
type of coordinates, this fact will be stated explicitly. Note that Section 4.3.2 has 
information on substitutions and transformations relevant to the three-dimensional 
case. 


4.13.2 CARTESIAN COORDINATES IN SPACE 


In Cartesian coordinates (or rectangular coordinates), a point P is referred to by 
three real numbers, indicating the positions of the perpendicular projections from the 
point to three fixed, perpendicular, graduated lines, called the axes. If the coordinates 
are denoted x, y, z, in that order, the axes are called the x-axis, etc., and we write 
P = (x,y,z). Often the x-axis is imagined to be horizontal and pointing roughly 
toward the viewer (out of the page), the y-axis also horizontal and pointing more 
or less to the right, and the z-axis vertical, pointing up. The system is called right- 
handed if it can be rotated so the three axes are in this position. Figure 4.33 shows a 
right-handed system. The point x = 0, y = 0, z = 0 is the origin, where the three 
axes intersect. 


FIGURE 4.33 
In Cartesian coordinates, P = (4.2, 3.4, 2.2). 


Zz 


4.13.3. CYLINDRICAL COORDINATES IN SPACE 


To define cylindrical coordinates, we take an axis (usually called the z-axis) and a 
perpendicular plane, on which we choose a ray (the initial ray) originating at the 
intersection of the plane and the axis (the origin). The coordinates of a point P are 
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FIGURE 4.34 
Among the possible sets (r,0,z) of cylindrical coordinates for P are (10,30°,5) and 


(10, 390°, 5). 





the polar coordinates (r, 0) of the projection of P on the plane, and the coordinate z 
of the projection of P on the axis (Figure 4.34). See Section 4.3.4 for remarks on the 
values of r and 6. 


4.13.4 SPHERICAL COORDINATES IN SPACE 


To define spherical coordinates, we take an axis (the polar axis) and a perpendicular 
plane (the equatorial plane), on which we choose a ray (the initial ray) originating 
at the intersection of the plane and the axis (the origin O). The coordinates of a point 
P are the distance p from P to the origin, the (zenith) angle ¢ between the line OP 
and the positive polar axis, and the (azimuth) angle @ between the initial ray and the 
projection of OP to the equatorial plane. See Figure 4.35. As in the case of polar 
and cylindrical coordinates, 0 is only defined up to multiples of 360°, and likewise ¢. 
Usually ¢ is assigned a value between 0 and 180°, but values of ¢ between 180° and 
360° can also be used; the triples (p, ¢, 0) and (p, 360° — ¢, 180° + @) represent the 
same point. Similarly, one can extend p to negative values; the triples (p, 6,0) and 
(—p, 180° — ¢, 180° + 6) represent the same point. 


4.13.5 RELATIONS BETWEEN CARTESIAN, CYLINDRICAL, 
AND SPHERICAL COORDINATES 
Consider a Cartesian, a cylindrical, and a spherical coordinate system, related as 


shown in Figure 4.36. The Cartesian coordinates (x,y,z), the cylindrical coordi- 
nates (r, 0, z), and the spherical coordinates (p, ¢, 0) of a point are related as follows 
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FIGURE 4.35 
A set of spherical coordinates for P is (p,0,) = (10, 60°, 30°). 





(where the tan~! function must be interpreted correctly in all quadrants): 








16 = —Y__ 
xr=rcosé r=Ve+y? iad x? +y? 
cart + cyl y =rsing 6=tan + g cos6 = = 
x 2 4 4,2 
Z=2 ee 
22 
Z=2 
. r 
a Ore sind = ———— 
r=psing e pai é r? + 2 
r 
cyl + sph z= pcosd o = tan — cos = 
0=0 mee 
d= 0— 
p= x? + y? + 2? 
x = pcosOsin gd @= tan“ 
cart <> sph y = psinésing ee x+y? 
z=pcos@ Zz 





geo y? + 22 


4.13.6 HOMOGENEOUS COORDINATES IN SPACE 


A quadruple of real numbers (x : y : z : t), with t 4 0, is a set of homogeneous 
coordinates for the point P with Cartesian coordinates (a/t, y/t, z/t). Thus the 
same point has many sets of homogeneous coordinates: (x : y: z: t) and (a’:y': 
z' : t') represent the same point if and only if there is some real number a such that 
wv =az,y = ay, 2 = az,t’ = at. If P has Cartesian coordinates (xo, yo, 20), 
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FIGURE 4.36 


Standard relations between Cartesian, cylindrical, and spherical coordinate systems. The 
origin is the same for all three. The positive z-axes of the Cartesian and cylindrical systems 
coincide with the positive polar axis of the spherical system. The initial rays of the cylindrical 
and spherical systems coincide with the positive x-axis of the Cartesian system, and the rays 
6 = 90° coincide with the positive y-axis. 








one set of homogeneous coordinates for P is (20, yo, 20, 1). 

Section 4.3.5 has more information on the relationship between Cartesian and 
homogeneous coordinates. Section 4.14.2 has formulas for space transformations in 
homogeneous coordinates. 





4.14 SPACE SYMMETRIES OR ISOMETRIES 


A transformation of space (invertible map of space to itself) that preserves distances 
is called an isometry of space. Every isometry of space is a composition of transfor- 
mations of the following types: 


The identity (which leaves every point fixed) 

A translation by a vector v 

A rotation through an angle a around a line L 

A screw motion through an angle a around a line L, with displacement d 

A reflection in a plane P 

A glide-reflection in a plane P with displacement vector v 

A rotation-reflection (rotation through an angle a@ around a line L composed 
with reflection in a plane perpendicular to L). 


SO ee 


The identity is a particular case of a translation and of a rotation; rotations are 
particular cases of screw motions; reflections are particular cases of glide-reflections. 
However, as in the plane case, it is more intuitive to consider each case separately. 
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4.14.1 SYMMETRIES: CARTESIAN COORDINATES 


In the formulas below, multiplication between a matrix and a triple of coordinates 
should be carried out regarding the triple as a column vector (or a matrix with three 
rows and one column). 


1. Translation by (x9, Yo, 20): 
(x,y,z) 4 (©+ 20, ¥+ Yo, % + 20). (4.14.1) 
2. Rotation through a (counterclockwise) around the line through the origin with 


direction cosines a, b, c (so that a? + b? + c? = 1, see page 257): (x,y,z) 
M(x, y,z), where M is the matrix 





a?(1—cosa)+cosa ab(1— cosa) — csina ac(1— cosa) + bsina 
ab(1—cosa)+csina b?(1—cosa)+cosa be(1— cosa) — asina 
ac(1 — cosa) — bsina bc(1— cosa) +asina c?(1—cosa) +cosa 
(4.14.2) 
3. Rotation through a (counterclockwise) around the line with direction cosines 
a, b,c through an arbitrary point (x0, yo, 20): 


(x,y, 2) + (x0, Yo, 20) + M(x — 20, y — Yo, 2 — 20); (4.14.3) 
where M is given by Equation (4.14.2). 

4. Arbitrary rotations and Euler angles: Any rotation of space fixing the origin 
can be decomposed as a rotation by ¢ about the z-axis, followed by a rotation 
by 6 about the y-axis, followed by a rotation by ~ about the z-axis. The 
numbers @, @ and w are called the Euler angles of the composite rotation, 
which acts as: (x, y, z) +> M(a,y, z), where M is the matrix 





cos @cos#cosw —singsinw —sin¢dcos@cosw—cos¢dsinw sin@cosw 
sing@cosw +cosdcos@sinw —singcos@siny+cos¢dcosw sindsiny 
—cos@sind sin @ sind cos 6 


4.14.4 
(An alternative decomposition, more natural if we think of the coordinate cen at 


a rigid trihedron that rotates in space, is the following: a rotation by w about the 
z-axis, followed by a rotation by @ about the rotated y-axis, followed by a rotation 
by ¢ about the rotated z-axis. Note that the order is reversed.) 

Provided that 6 is not a multiple of 180°, the decomposition of a rotation in this 
form is unique (apart from the ambiguity arising from the possibility of adding a 
multiple of 360° to any angle). Figure 4.37 shows how the Euler angles can be read 
off geometrically. 

Warning: Some references define Euler angles differently; the most common 
variation is that the second rotation is taken about the x-axis instead of about the 
y-axis. 


5. Screw motion with angle a and displacement d around the line with direction 
cosines a, b, c through an arbitrary point (29, yo, 20): 


(a, y, 2) + (ao tad, yo +bd, 29 +cd)+ M(x—20, y—Yyo, 2-20), (4.14.5) 
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FIGURE 4.37 
The coordinate rays Ox, Oy, Oz, together with their images O€, On, OC under a rotation, fix 


the Euler angles associated with that rotation, as follows: 0 = zO¢, yy = xOr = yOs, and 
o = sOn. (Here the ray Or is the projection of OG to the xy-plane. The ray Os is determined 
by the intersection of the xy- and &n-planes.) 





where MM is given by (4.14.2). 


6. Reflection 
in the xy-plane: (x,y, 2) + (x, y, —2 


i 
) 


in the xz-plane: (x,y, 2) +> (x, —y, 2). 


(4.14.6) 
in the yz-plane: (x,y,z) H (—a, y, 2). 


7. Reflection in a plane with equation ax + by + cz +d = 0: 


(a, y, Zz) Zappa Mla, Yo, 20) — (2ad,2bd,2cd)), (4.14.7) 
where Vis the matrix 
—-a@ +0? +c? —2ab —2ac 
M= —2ab a? — 0? +e —2bc . (4.14.8) 
—2ac —2bc a? +b? — 


8. Reflection in a plane going through (29, yo, 20) and whose normal has direc- 
tion cosines a, b,c: 


(x,y, 2) +> (ao + yo + 20) + M(x — 20, y — Yo, 2 — 20); (4.14.9) 
where I is as in (4.14.8). 





9. Glide-reflection in a plane P with displacement vector v: Apply first a reflec- 
tion in P, then a translation by the vector v. 
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4.14.2 SYMMETRIES: HOMOGENEOUS COORDINATES 


All isometries of space can be expressed in homogeneous coordinates in terms of 
multiplication by a matrix. As in the case of plane isometries (Section 4.4.2), this 
means that the successive application of transformations reduces to matrix multipli- 
cation. (In the formulas below, [// 9] is the 4 x 4 projective matrix obtained from 
the 3 x 3 matrix MM by adding a row and a column as stated.) 


1 0 0 a 
1. Translation by (x0, Yo, 20): : ) : ca 
0 0 0 1 

2. Rotation through the origin: i : , 
where M is given in (4.14.2) or (4.14.4), as the case may be. 

3. Reflection in a plane through the origin: “4 , 


where I is given in (4.14.8). 


From this, one can deduce all other transformations, as in the case of plane 
transformations (see page 200). 





4.15 OTHER TRANSFORMATIONS OF SPACE 


4.15.1 SIMILARITIES 


A transformation of space that preserves shapes is called a similarity. Every simi- 
larity of the plane is obtained by composing a proportional scaling transformation 
(also known as a homothety) with an isometry. A proportional scaling transformation 
centered at the origin has the form 


(x,y,z) + (ax, ay, az), (4.15.1) 
where a ¥ 0 is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 


a 00 0 
0 a 0 0 

He=|1) 9 a 0 (4.15.2) 
Oo 1 


In cylindrical coordinates, the transformation is (7,0, z) + (ar, 0, az). In spherical 
coordinates, it is (r, 6,0) ++ (ar, d, 8). 
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4.15.2 AFFINE TRANSFORMATIONS 


A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an affine transformation. There are two important particular cases of such 
transformations: 


1. Anon-proportional scaling transformation centered at the origin has the form 
(x,y,z) + (ax, by, cz), where a,b,c # 0 are the scaling factors (real num- 
bers). The corresponding matrix in homogeneous coordinates is 


a 0 0 0 
0 b 0 0 

Hate = 00 c¢ Ol: (4.15.3) 
00 0 1 


2. A shear in the x-direction and preserving horizontal planes has the form 
(x,y,z) +> (a +1z,y,z), where r is the shearing factor. The correspond- 
ing matrix in homogeneous coordinates is 


feo 

610 0 

S, = aa ae coe (4.15.4) 
0001 


Every affine transformation is obtained by composing a non-proportional scaling 
transformation with an isometry, or one or two shears with a homothety and an isom- 
etry. 


4.15.3 PROJECTIVE TRANSFORMATIONS 


A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any spatial projective transformation can be 
expressed by an invertible 4 x 4 matrix in homogeneous coordinates; conversely, any 
invertible 4 x 4 matrix defines a projective transformation of space. Projective trans- 
formations (if not affine) are not defined on all of space, but only on the complement 
of a plane (the missing plane is “mapped to infinity”). 

The following particular case is often useful, especially in computer graphics, 
in projecting a scene from space to the plane. Suppose an observer is at the point 
E = (2o,Yo, 20) of space, looking toward the origin O = (0,0,0). Let P, the 
screen, be the plane through O and perpendicular to the ray EO. Place a rectangular 
coordinate system €7 on P with origin at O so that the positive 7-axis lies in the half- 
plane determined by £ and the positive z-axis of space (that is, the z-axis is pointing 
“up” as seen from £). Then consider the transformation that associates with a point 
X = (x,y, 2) the triple (€,7, ¢), where (€, 7) are the coordinates of the point, where 
the line EX intersects P (the screen coordinates of X as seen from EF), and ¢ is the 
inverse of the signed distance from X to EF along the line HO (this distance is the 
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depth of X as seen from £). This is a projective transformation, given by the matrix 


—r7 yo rx 0 0 
—TX02% —TYoZ rp- oO 

F 0 “ g fl “ (4.15.5) 
PX —pyo —p20 Tp 


with p = \/z2 t+ yg andr = \/x2 + y6 + 22. 


4.16 DIRECTION ANGLES AND DIRECTION 
COSINES 


Given a vector (a, b, c) in three-dimensional space, the direction cosines of this vec- 
tor are 








= a 
ee Lee oe aa 
b 
cos 2 = ——————., 
P= Tete (4.16.1) 
6; 
cosy = zm D2 = = 








Here the direction angles a, 3, y are the angles that the vector makes with the posi- 
tive x-, y- and z-axes, respectively. In formulas, usually the direction cosines appear, 
rather than the direction angles. We have 


cos? a + cos? 8 + cos? y=. (4.16.2) 





4.17 PLANES 


The (Cartesian) equation of a plane is linear in the coordinates x, y, and z: 

ax +by+cz+d=0. (4.17.1) 
The normal direction to this plane is (a, b, c). The intersection of this plane with the 
x-axis, or x-intercept, is x = —d/a, the y-intercept is y = —d/b, and the z-intercept 
is z = —d/c. The plane is vertical (perpendicular to the ay-plane) if c = 0. It is 
perpendicular to the x-axis if b = c = 0, and likewise for the other coordinates. 

When a? + b? + c? = 1 and d < 0 in the equation ax + by + cz + d = 0, the 
equation is said to be in normal form. In this case —d is the distance of the plane to 
the origin, and (a, b, c) are the direction cosines of the normal. 

To reduce an arbitrary equation az + by + cz +d = 0 to normal form, divide by 
+Va? + b? + c?, where the sign of the radical is chosen opposite the sign of d when 
d # 0, the same as the sign of c when d = 0 and c ¥ 0, and the same as the sign of 
b otherwise. (If b is also equal to 0, then there is no equation.) 





258 CHAPTER 4. GEOMETRY 


4.17.1 PLANES WITH PRESCRIBED PROPERTIES 


1. Plane through (29, yo, Zo) and perpendicular to the direction (a, b, c): 





a(x — #9) + b(y — yo) + c(z — zo) = 0. (4.17.2) 
2. Plane through (29, yo, 20) and parallel to the directions (a1,b1,c,) and 
(a2, be, c2): 
&-—% Y-Yo 2 40 
ay by c, |=0. (4.17.3) 
a2 be c2 


3. Plane through (29, yo, 20) and (21, y1, 21) and parallel to the direction (a, b, c): 
tT—2XQ Y-Yo *%-— 40 
T—-X% Y1—- Yo 41-20) = 0. (4.17.4) 
a b c 
4. Plane going through (xo, yo, 20), (@1, y1, 21) and (x2, ya, 22): 
cr ey z 1 
&-—%O Y Yo 4 40 
=0 or T1—-% Y1i-VYo 41-20 = 0. 
t2— XO Y2—- Yo 427 40 
(4.17.5) 
(The last three formulas remain true in oblique coordinates; see page 198.) 
5. The distance from the point (xo, yo, Zo) to the plane az + by + cz +d = Ois 
axo + byp + cz9 + d 
(Fee ee 
6. The angle between two planes agx + boy + coz + do = 0 and ayx + diy + 
cz +d, = Ois 


(4.17.6) 


-1 aga, + bby + coer 


fat +et+e/a+e+cd 
In particular, the two planes are parallel when ag : bp : Co = Gy : by : cy, and 
perpendicular when aga, + b9by + coc, = 0. 


cos (4.17.7) 


4.17.2; CONCURRENCE AND COPLANARITY 


Four planes agpz+boy+coz+dp = 0, aya+byy+c,z+d, = 0, agx+boytcoz+dz = 
0, and agx + bs3y + c3z + d3 = 0 are concurrent (share a point) if and only if 
ap bo co do 
a, by cy dy 
ay bz c2 de 
az bg c3 d3 


= 0. (4.17.8) 


4.18. LINES IN SPACE 259 


Four points (0, yo, 20), (1, 1, 21), (2, ya, 22) and (a3, y3, 23) are coplanar (lie 
on the same plane) if and only if 


Z Yo 2% 1 
Uy Y1 ZL 1 

= 0. 4.17.9 
v2 Y2 22 1 ( ) 


r3 ys 23 1 
(Both of these assertions remain true in oblique coordinates.) 





4.18 LINES IN SPACE 


Two planes that are not parallel or coincident intersect in a straight line, such that 
one can express a line by a pair of linear equations 
ax + by+cz+d=0 

Pane +cz+d' =0 aay 
such that be’ — cb’, ca’ — ac’, and ab’ — ba’ are not all zero. The line thus defined is 
parallel to the vector (bc’ — cb’, ca’ — ac’, ab! — ba’). The direction cosines of the line 
are those of this vector. See Equation (4.16.1). (The direction cosines of a line are 
only defined up to a simultaneous change in sign, because the opposite vector still 
gives the same line.) 

The following particular cases are important: 





1. Line through (x0, yo, Zo) parallel to the vector (a, b, c): 


t—X  Y— Yo z— 20 











= ; (4.18.2) 
a b c 
2. Line through (xo, yo, Zo) and (x1, y1, 21): 
Po og a (4.18.3) 


t1—-%o Yi — Yo 21 — 20 
This line is parallel to the vector (x1 — 20, y1 — Yo, 21 — 20): 





4.18.1. DISTANCES 


1. The distance between two points in space is the length of the line segment 
joining them. The distance between the points (9, yo, 20) and (#1, y1, 21) is 


(a1 — Xo)? + (y1 — yo)? + (21 — 20)?. (4.18.4) 
2. The point k% of the way from Po = (Xo, yo, 20) to Py = (41, yi, 21) is 
100 100 100 
(The same formula also applies in oblique coordinates.) This point divides the 
segment PP; in the ratio k : (100 — k). As a particular case, the midpoint of 
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PoP, is given by 





Ly +t Yit yo 21+ 20 
——_., ——_ } . 4.18. 

( a as ) (4.18.6) 
3. The distance between the point (20, yo, 20) and the line through (21, yi, 21) in 


direction (a, b, c): 





2 2 
To—- 271 YoY 
a b 


2 
Yor-Y¥1 207 41 
b Cc 


20 — 2, FO 1 
Cc a 
a? + b? + ¢? 


- + 

















(4.18.7) 
4. The distance between the line through (xo, yo, Zo) in direction (ao, bo, co) and 
the line through (a1, y1, 21) in direction (a1, b1, ¢1): 


T%]—% Yi-VYo 41 40 
ao bo Co 
ay by C1 


(4.18.8) 











4.18.2 ANGLES 


The angle between lines with directions (ao, bo, co) and (a1, bi, c1): 


cos7! (<tc St ; (4.18.9) 
ag tbo t+ qVait+oi+e¢ 
In particular, the two lines are parallel when ap : bo : co = ay : by : Cy, and 
perpendicular when aga, + bob + coc, = 0. 
The angle between lines with direction angles ag, 89, yo and a1, (1,71: 


cos” ‘(cos Qo COS 1 + Cos Gg Cos 31 + COS Yo COS71). (4.18.10) 


4.18.3 CONCURRENCE, COPLANARITY, PARALLELISM 


Two lines, each specified by point and direction, are coplanar if and only if the 
determinant in the numerator of Equation (4.18.8) is zero. In this case they are 
concurrent (if the denominator is non-zero) or parallel (if the denominator is zero). 

Three lines with directions (ao, bo, co), (a1, b1, c1) and (a2, bg, cz) are parallel 
to a common plane if and only if 


a, by a} =0. (4.18.11) 
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4.19 POLYHEDRA 


For any polyhedron topologically equivalent to a sphere—in particular, for any con- 
vex polyhedron—the Euler formula holds: 

v= ef H=2, (4.19.1) 
where v is the number of vertices, e is the number of edges, and f is the number of 
faces. 

Many common polyhedra are particular cases of cylinders (Section 4.20) or 
cones (Section 4.21). A cylinder with a polygonal base (the base is also called a 
directrix) is called a prism. A cone with a polygonal base is called a pyramid. A 
frustum of a cone with a polygonal base is called a truncated pyramid. Formu- 
las (4.20.1), (4.21.1), and (4.21.2) give the volumes of a general cylinder, cone, and 
truncated cone. 

A prism whose base is a parallelogram is a parallelepiped. The volume of a 
parallelepiped with one vertex at the origin and adjacent vertices at (11, 41, 21), 
(x2, yo, 22), and (a3, y3, 23) is given by 

ZT Yt 71 
volume = |% yo 22]. (4.19.2) 
U3 Y3 23 
The rectangular parallelepiped is a particular case: all of its faces are rectangles. If 
the side lengths are a, b, c, the volume is abc, the total surface area is 2(ab+-ac+bc), 
and each diagonal has length Va? + b? + c?. When a = b = c we get the cube. See 
Section 4.19.1. 

A pyramid whose base is a triangle is a tetrahedron. The volume of a tetrahedron 
with one vertex at the origin and the other vertices at (x1, yi, 21), (2, Y2, 22), and 
(3, ys, 23) is given by 

TZ, Yi. 1 
volume = =|%2 Yo 22|. (4.19.3) 
T3 Y3 23 


In a tetrahedron with vertices Pp, P;, P2, P3, let dj; be the distance (edge length) 
from P; to P;. Form the determinants 


0 1 1 1 1 
1 0 dj, doy dos 
A= |1 Gi © dy ds) and [= 
1 djp diz 0 dbs 
1 djs diz d33 0 


Then the volume of the tetrahedron is \/|A|/288, and the radius of the circumscribed 


sphere is $\/|T'/2A]. 


0 dir doz dos 
a, ze ds 0 
03 13 23 


(4.19.4) 
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Expanding the determinant we find that the volume V satisfies the formula: 
144V? = — doi di2d0 a do, 413403 ~ di2di3d35 = do2do3435 
+ dpi doodis + F2do2di3 + dpi Fi2dos + A24>2d03 
+ djgdi3d53 + dod 353 + doi d}2433 + do. d52435 
+ doy dj3d33 + dod 3433 + do 493433 + di2d}3435 (4.19.5) 
— dp2doodiz — doedizdis 
— d}x4ind03 — di2dgd03 
— do doi 433 — do, d33423.- 
(Mnemonic: Each of the first four negative terms corresponds to a closed path around 
a face; each positive term to an open path along three consecutive edges; each re- 
maining negative term to a pair of opposite edges with weights 2 and 1. All such 
edge combinations are represented.) 
For an arbitrary tetrahedron, let P be a vertex and let a, b, c be the lengths of the 


edges converging on P. If A, B, C are the angles between the same three edges, the 
volume of the tetrahedron is 


1 
V= gabev 1 — cos? A — cos? B — cos? C + 2cos Acos BcosC. (4.19.6) 

















4.19.1 CONVEX REGULAR POLYHEDRA 


Figure 4.38 shows the five regular polyhedra, or Platonic solids. In the following 
tables and formulas, a is the length of an edge, 6 the dihedral angle at each edge, R 
the radius of the circumscribed sphere, r the radius of the inscribed sphere, V the 
volume, S the total surface area, v the total number of vertices, e the total number of 
edges, f the total number of faces, p the number of edges in a face (3 for equilateral 
triangles, 4 for squares, 5 for regular pentagons), and q the number of edges meeting 
at a vertex. 
Note that fp = vq = 2e. 














fa 180° /q) 

PO Perec (pases 180° 180° 
oe eae ae tan ( ol ) tan ( = ) : 
R__4sin(180°/q) : : 

a Far . 40° ae le cud 

a ( pee cos ; ae eek 

Ys Seat tan { — ] , V =9r8. 

a 2 p 2 


(4.19.7) 


4.19. POLYHEDRA 263 


FIGURE 4.38 
The Platonic solids. Top: the tetrahedron (self-dual). Middle: the cube and the octahedron 


(dual to one another). Bottom: the dodecahedron and the icosahedron (dual to one another). 


Regular tetrahedron 70°31/44” 
Cube 90° 

Regular octahedron 109°28'16” 
Regular dodecahedron 116°33'54” 
Regular icosahedron 138°11'23” 
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Tetrahedron V6/4 0.612372 V6/12 0.204124 
Cube V3/2 0.866025 1 0.5 


2. 
Octahedron V2/2 0.707107 V6/6 0.408248 
Dodecahedron | $(V15+ V3) 1.401259 | #/250+110V5 1.113516 
1 
a 





Icosahedron 


V10+2V5 0.951057 | 7V42+18V5 0.755761 


Tetrahedron V3 1.73205 V2/12 0.117851 
Cube 6 6. 1 L. 

Octahedron 2/3 3.46410 J2/3 0.471405 
Dodecahedron | 3 25+10V5 20.64573 | 4(15+7V5) 7.663119 
Icosahedron 5/3 8.66025 3(3+ V5) 2.181695 





4.19.2 POLYHEDRA NETS 


Nets for the five Platonic solids are shown: (a) tetrahedron, (b) octahedron, (c) icosa- 
hedron, (d) cube, and (e) dodecahedron. Paper models can be made by making an 
enlarged photocopy of each, cutting them out along the exterior lines, folding on the 
interior lines, and using tape to join the edges. 


. & aravara 


(c) 




















(d) (e) 
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FIGURE 4.39 
Left: an oblique cylinder with generator L and directrix C’. Right: a right circular cylinder. 








4.20 CYLINDERS 


Given a line Z andacurve Cina plane P, the cylinder with generator L and directrix 
C is the surface obtained by moving L parallel to itself, so that a point of L is always 
on C. If L is parallel to the z-axis, the surface’s implicit equation does not involve 
the variable z. Conversely, any implicit equation that does not involve one of the 
variables (or that can be brought to that form by a change of coordinates) represents 
a cylinder. 

If C' is a simple closed curve, we also apply the word cylinder to the solid en- 
closed by the surface generated in this way (Figure 4.39, left). The volume contained 
between P and a plane P’ parallel to P is 

V = Ah = Alsin6@, (4.20.1) 
where A is the area in the plane P enclosed by C, h is the distance between P and P’ 
(measured perpendicularly), / is the length of the segment of L contained between 
P and P’, and @ is the angle that L makes with P. When 6 = 90° we have a right 
cylinder, and h = 1. For a right cylinder, the lateral area between P and P’ is hs, 
where s is the length (circumference) of C. 

The most important particular case is the right circular cylinder (often simply 
called a cylinder). If r is the radius of the base and h is the altitude (Figure 4.39, 
right), the lateral area is 2rrh, the total area is 2nr(r + h), and the volume is arr7h. 
The implicit equation of this surface can be written x? + y? = r?; see also page 219. 








4.21 CONES 


Given a curve C' in a plane P and a point O not in P, the cone with vertex O and 
directrix C' is the surface obtained as the union of all rays that join O with points 
of C. If O is the origin and the surface is given implicitly by an algebraic equation, 
that equation is homogeneous (all terms have the same total degree in the variables). 
Conversely, any homogeneous implicit equation (or one that can be made homoge- 
neous by a change of coordinates) represents a cone. 
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FIGURE 4.40 


Top: a cone with vertex O and directrix C’. Bottom left: a right circular cone. Bottom right: 


A frustum of the latter. 
/ \ 


If C is a simple closed curve, we also apply the word cone to the solid enclosed 
by the surface generated in this way (Figure 4.40, top). The volume contained be- 
tween P and the vertex O is 








C 





V = #FAh, (4.21.1) 


where A is the area in the plane P enclosed by C and h is the distance from O and 
P (measured perpendicularly). 

The solid contained between P and a plane P’ parallel to P (on the same side 

of the vertex) is called a frustum. Its volume is 

V = gh(A+ A’ + VAA’), (4.21.2) 
where A and A’ are the areas enclosed by the sections of the cone by P and P’ (often 
called the bases of the frustum), and h is the distance between P and P’. 

The most important particular case of a cone is the right circular cone (often 
simply called a cone). If r is the radius of the base, h is the altitude, and / is the 
length between the vertex and a point on the base circle (Figure 4.40, bottom left), 
the following relationships apply: 


b= Vr? +h, 
Lateral area = trl = mr Jr? + h2 ; 
Total area = mrl + ar? = ar(r+/r2 + h?), and 
Volume = 4ar7h. 


3 


The implicit equation of this surface can be written x? + y? = 2? 


; see Section 4.9. 
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For a frustum of a right circular cone (Figure 4.40, bottom right), 
I= (one, 
Lateral area = 7(r, + 12), 
+r24+(ri+r2)l), and 


Volume = amh(r} +73 +ryre). 





tel 
Total area = 1(r7 
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4.22.1 CURVES 
4.22.1.1 Definitions 


1. A regular parametric representation of class C*®, k > 1, is a vector valued 
function f : I —» R°, where I C R is an interval that satisfies (i) f is of class 
C¥ (i.e., has continuous k"" order derivatives), and (ii) f(t) 4 0, for all t € J. 
In terms of a standard basis of R®, we write x = f(t) = (fi (t), fo(t), fs(t)), 
where the real valued functions f;, i = 1, 2,3 are the component functions of f. 

2. An allowable change of parameter of class C* is any C* function ¢: J + I, 
where J is an interval and ¢(.J) C I, that satisfies ’(7) 4 0, for all t € J. 

3. A C* regular parametric representation f is equivalent to a C* regular para- 
metric representation g if and only if an allowable change of parameter ¢ exists 
so that d(I,) = I, and g(7) = f(¢(7)), for all tr € Ig. 

4. A regular curve C of class C* is an equivalence class of C* regular parametric 
representation under the equivalence relation on the set of regular parametric 
representations defined above. 

5. The arc length of any regular curve C' defined by the regular parametric repre- 


b 
sentation f, with I = [a, b], is defined by L = i |f(u)| du. 





t 
6. An arc length parameter along C is defined by s = a(t) = af |f'(u)| du. 


The choice of sign is arbitrary and c is any number in [. 

7. A natural representation of class C* of the regular curve defined by the regular 
parametric representation f is defined by g(s) = f(a~1(s)), for all s € [0, LZ}. 

8. A property of a regular curve C is any property of a regular parametric rep- 
resentation representing C’ which is invariant under any allowable change of 
parameter. 

9. Let g be a natural representation of a regular curve C. The following quantities 
may be defined at each point x = g(s) of C: 


Binormal line y = Ab(s) +x 
Curvature k(s) = n(s) - k(s) 
Curvature vector k(s) = t(s) 
Moving trihedron {t(s),n(s),b(s)} 
Normal plane (y —x)-t(s) =0 
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Osculating plane (y — x) -b(s) =0 

Osculating sphere (y—c)-(y—c) =r? where 
c =x + p(s)n(s) — (&(s)/(«?(s)7(s)))b(s) 
and r? = p?(s) + K?(s)/(K4(s)r?(s)) 











Principal normal line y = An(s) +x 

Principal normal unit n(s) = +k(s)/|k(s)], (s) # 0 defined to be 
vector continuous along C’ 

Radius of curvature p(s) = 1/|K(s)|, i(s) #0 

Rectifying plane (y — x)- nis =0 

Tangent line y = At(s) + 

Torsion T(s) = —n(s ‘. b(s) 

Unit binormal vector b(s) = t(s) x n(s) 

Unit tangent vector t(s) = g(s) with (als) = “t) 


4.22.1.2 Results 

The arc length L and the arc length parameter s of any regular parametric represen- 
tation f are invariant under any allowable change of parameter. Thus, L is a property 
of the regular curve C defined by f. 











The arc length parameter satisfies 4¢ = a/(t) = + if (t) 
|f (s)| = 1, if and only if ¢ is an arc length parameter. Thus, arc length parameters 
are uniquely determined up to the transformation s +> s = +s + so, where So is any 
constant. 


The curvature, torsion, tangent line, normal plane, principal normal line, recti- 
fying plane, binormal line, and osculating plane are properties of the regular curve 
C defined by any regular parametric representation f. 

If x = (a(t), y(t), z(t)) = f(t) is any regular representation of a regular 
curve C,, the following results hold at point f(t) of C: 


«| = x” x x’| _ (2! yl — yz? + (a2! — 2"0/)? + (ya! — vy’)? 
Ix’|° (a2 + yf? + 2/2)3/2 
det(x’, x”, x!”) 7 (x! x x!) x!) 
a Ix’ x x x!"|? a Ix’ x x x! |? 


7 "(a ty"! — y! x") + Zz'(a my! — a! y"") + z ‘(ax "y My —al"y") 
a ce + y2 + 2/2) (x ae yl? + Py 
(4.22.1) 
The vectors of the moving trihedron satisfy the Serret—Frenet equations 
t=«n, n=-—«t+7b, b=- (4.22.2) 
For any plane curve represented parametrically by x = f(t “ — “(t f(t), 0), 


d?x 
dt 








(4.22.3) 
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Expressions for the curvature vector k and the curvature || = p~/ of a plane curve 
corresponding to different representations are as follows: 


(ij 98), Led — ge 

e For{z = t), = t k = — — (-9, & |S TST 

(@= 10) y= KO) = Gerais) | ; era 

y y 
e Fory = f(z) = Ga pe) |K| = (4+ y" 3/2 
2 12 gall 
e Forr=f(0) k= (tind — r e080, e080 — rsin8) 
ror 


a (r2 + r!?)3/2 
The equation of the osculating circle of a plane curve is given by 

GG -O= pf, (4.22.4) 
where ¢ = x + p’k is the center of curvature. 


THEOREM 4.22.1 = (Fundamental existence and uniqueness theorem) 
Let &(s) and T(s) be any continuous functions defined for all s € |a,b]. Then there 
exists, up to a congruence, a unique space curve C for which k is the curvature 
function, T is the torsion function, and s an arc length parameter along C. 


4.22.1.3 Example 


A regular parametric representation of the circular helix is given by x = f(t) = 
(acost, asint, bt), fort € R, where a > 0 and b ¥ 0 are constant. Differentiating 


with respect to t: 


x’ = (—asint, acost,b), 


x” = (—acost, —asint,0), (4.22.5) 


x” =( asint,—acost,0), 


so that $$ = |x’| = Va? + b?. Hence, 


1. Arc length parameter: s = a(t) = t(a2 + b?)2 
2. Curvature vector: k = a = aa = (a* + b”)—!(—acost, —asint, 0) 
3. Curvature: = |k| = a(a? + 67) 
4. Principal normal unit vector: n = k/ |k| = (— cost, — sint, 0) 
5. Unit tangent vector: t = x! /|x’| = (a? + b?)~2 (—asint, acost, b) 
6. Unit binormal vector: 
b=t x n= (a? + b?)~2(bsint, bcost, a) 
- dt db 
b= aa b(a? + b?)~1 (cost, sin t, 0) 


7. Torsion: T = —n-b = b(a? + b?)7! 


The values of |«| and 7 can be verified using (4.22.1). The sign of (the invariant) + 
determines whether the helix is right-handed, 7 > 0, or left-handed, T < 0. 
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4.22.2 SURFACES 
4.22.2.1 Definitions 


1. A coordinate patch of class C*, k > 1 ona surface S' C R? is a vector valued 


function f : U + S, where U C R? is an open set, that satisfies (i) f is 


class C* on U, (ii) (u,v) x #(u,v) F 0, for all (u,v) € U, and (iii) f is 


one-to-one and bi-continuous on U. 


. In terms of a standard basis of R® we write x = f(u,v) = (fi(u,v), fo(u,v), 


f3(u, v)), where the real valued functions { f1, fo, fs} are the component func- 
tions of f. The notation x; = x, = 4, x. =x, = 4,u! = u,v? = v, is 
frequently used. 


. A Monge patch is a coordinate patch where f has the form f(u,v) = 


(u,v, f(u,v)), where f is a real valued function of class C*. 


. The u-parameter curves v = vg on S are the images of the lines v = vp in U. 


They are parametrically represented by x = f(u, vg). The v-parameter curves 
U = Uo are defined similarly. 


. An allowable parameter transformation of class C* is a one-to-one function 


@:U — V, where U,V C R? are open, that satisfies 


oot Od" (4), 
det | 250%) Bel)! 4 0, (4.22.6) 
Gy (u,v) (u,v) 
for all (u,v) € U, where the real valued functions, ¢ and ¢, defined by 
u,v) = u,v), u,v)) are the component functions of @. One ma 
o(u,v) = (¢*(u,v), ¢?(u, v)) h p functi fo. O y 


also write the parameter transformation as &! = $'(u',u”), a = ¢7(u',u?). 





. A local property of surface S is any property of a coordinate patch that is 


invariant under any allowable parameter transformation. 


. Let f define a coordinate patch on a surface S. The following quantities may 


be defined at each point x = f(u, v) on the patch: 


Asymptotic direction A direction du : du for which k,, = 0 


Asymptotic line A curve on S whose tangent line at each point 
coincides with an asymptotic direction 





Dupin’s indicatrix ex? +2 fax + 9x3 = +1 
Elliptic point eg—f?>0 
First fundamental form I =dx- dx = gag(u, v) du* du? 
= E(u, v) du? + 2F (u,v) dudu + G(u, v) dv? 
E(u,v) = giu(u,v) =X1-°X1 
First fundamental metric F (u,v) = gi2(u, v) = X1° Xe 
coefficients G(u, Vv) = go2(u, v) = X2 + Xe 


Fundamental differential 


Gaussian curvature 


Geodesic curvature vector of 
curve C' on S through « 


Geodesic on S 
Hyperbolic point 


Line of curvature 


Mean curvature 


Normal curvature vector of 
curve C' on S through « 


Normal curvature in the 
du : dv direction 


Normal line 

Normal vector 
Parabolic point 
Planar point 
Principal curvatures 


Principal directions 


Second fundamental form 


Second fundamental metric 
coefficients 


Tangent plane 


Umbilical point 


Unit normal vector 


4.22. DIFFERENTIAL GEOMETRY 271 


dx = Xq du* = X, du + Xy dv (a repeated upper 
and lower index signifies a summation for 
a = 1,2) 


eg — f° 
oN ere 
k, =k — (k-N)N = [ii* + P'4,u97]xq. where 


I'3., denote the Christoffel symbols of the second 
kind for the metric gag, defined in Section 5.9.3 
A curve on S' which satisfies k, = 0 at each point 
eg — f? <0 

A curve on S whose tangent line at each point 
coincides with a principal direction 


Ki + K2 gE +eG—2fF 

B= = 2. 
2 2(EG — F?) 
k,, = (k-N)N 
II 

n=k-N=— 
* q 
y=’AN4+x 


N = Xy X Xy 

eg — f? = Onotallofe, f,g =0 

e=f=g=0 

The extreme values «1 and k2 of Ky, 

The perpendicular directions du : dv in 

which «,,, attains its extreme values 

IT = —dx- dN = bag(u, v) du® du® 

= e(u, v) du? + 2f (u,v) dudv +t g(u, v) dv? 
e(u,v) = bii(u,v) = x11-N 
f(u,v) = aa, v) =X12°N 
ay = bo9(u, v) = Xo2-N 

)-N =0, ory =x + Ax, + pXy 


Kn = constant for all directions du : du 
_ Xy X Xy 


~~ Tey % 
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4.22.2.2 Results 


1. The tangent plane, normal line, first fundamental form, second fundamental 


form and all derived quantities thereof are local properties of any surface S. 


. The transformation laws for the first and second fundamental metric coeffi- 


cients under any allowable parameter transformation are given, respectively, 
by 
a Ou? du® OuY due 
foo = 985 Ga BGR ME bap = brs oea BE 


Thus gag and bag are the components of type (0, 2) tensors. 


(4.22.7) 


. I > 0 for all directions du : dv; and J = 0 if and only if du = dv = 0. 


. The angle 6 between two tangent lines to S at x = f(u,v) defined by the 


directions du : dv and du : dv, is given by 

Jap du*6u® 
(Gas du® du?) (gagduedu)s | 
The angle between the u-parameter curves and the v-parameter curves is 


given by cos0 = F(u,v)/(E(u,v)G(u,v))?. The u-parameter curves and 
v-parameter curves are orthogonal if and only if F'(u,v) = 0. 


cos) = (4.22.8) 


. Suppose two curves, y = fi (x) andy = f2(), intersect at the point P(X, Y). 


If the derivatives exist, then the angle of intersection (a) is given by: 
f(X) = fil) 
1+ fi(X)fa(X) 


If (tan a) > 0 then a is an acute angle; otherwise, a is an obtuse angle. 


tana = (4.22.9) 


. The arc length of a curve C on S, defined by x = f(u'(t), u?(t)), with a < 


t < b, is given by 


z= f Jap (u u?(t))uow? dt (4.22.10) 


a [ E(u(b, 0) + IF ul, (uo + Gul, ole at. 


. The area of S = f(U) is given by 


A= [f vax Jog (ut, u2)) du’ du? 


a V E(u, v)G(u,v) — F?(u, v) du dv. 
U 


(4.22.11) 


. The principal curvatures are the roots of the characteristic equation, det (bag — 


gas) = 0, which may be written as A? — bagg*?A + b/g = 0, where g? is 
the inverse of gag, b = det (bag), and g = det(gag). This expands into 


(EG — F?)\? — (eG —2fF +gE)\+eg— f? =0. (4.22.12) 





10. 


11. 


12. 
L3: 


14. 


15. 


16. 
17. 
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. The principal directions du : du are obtained by solving the homogeneous 


equation 
biag28 du“ du? — boa gig du“ du? = ; (4.22.13) 


or 
(eF — fE) du? + (eG — gE) dudv+(fG—gF)dv?=0. (4.22.14) 


Rodrigues formula: du : dv is a principal direction with principal curvature 
if and only if dN + «dx = 0. 


A point x = f(u,v) on S is an umbilical point if and only if there exists a 
constant & such that bag (u,v) = kgag(u, v). 


The principal directions at x are orthogonal if x is not an umbilical point. 


The u- and v-parameter curves at any non-umbilical point x are tangent to 
the principal directions if and only if f(u,v) = F(u,v) = 0. If f defines a 
coordinate patch without umbilical points, the u- and v-parameter curves are 
lines of curvature if and only if f = F = 0. 


If f = F = 0 ona coordinate patch, the principal curvatures are Kk; = e/E 
and k2 = g/G. It follows that the Gaussian and mean curvatures are 


9 22) oa8 
<I and H= (=+4). (4.22.15) 


2 


K = 
Gauss equation: Xap = TeX + bapN. 
Weingarten equation: Ny = —bogg? ky. 


Gauss—Mainardi—Codazzi equations: bagbys — baybas = Réapy, bab, — 
bey, + Pe pbs _ Te bse = 0, where R5qg+ is the Riemann curvature tensor. 


THEOREM 4.22.2 (Gauss’ theorema egregium) 


The Gaussian curvature KX depends only on the components of the first fundamental 
metric gag and their derivatives. 


THEOREM 4.22.3 = (Fundamental theorem of surface theory) 

Tf gag and bag are sufficiently differentiable functions of u and v which satisfy the 
Gauss—Mainardi-Codazzi equations, det(gag) > 9, 911 > 0, and g22 > 0, then a 
surface exists with I = gog du* du? and II = bog du“ du? as its first and second 
fundamental forms. This surface is unique up to a congruence. 
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4.22.2.3. Example: paraboloid of revolution 


A Monge patch for a paraboloid of revolution is given by x = f(u,v) = (u,v, u? 


+ 


v’), for (u,v) € U = R?. By successive differentiation: x, = (1,0,2u), x, = 
(0,1, 2v), Xun = (0,0, 2), Xu» = (0,0,0), and x,,, = (0,0, 2). 


1. 
2 


10. 


11. 


12. 


Unit normal vector: N = (1 + 4u2 + 4v?)~2 (—2u, —2v, 1). 


First fundamental coefficients: E(u,v) = gii(u,v) = 1+ 4u?, F(u,v) = 
gi2(u, v) = 4uv, G(u, v) = goo(u,v) = 14 40”. 





. First fundamental form: I = (1+4u?) du? +8uv du dv+ (1+4v?) dv”. Since 





F(u,v) =0=> u=O0orv =0, it follows that the u-parameter curve v = 0, 
is orthogonal to any v-parameter curve, and the v-parameter curve u = 0 is 
orthogonal to any u-parameter curve. Otherwise the u- and v-parameter curves 
are not orthogonal. 





. Second fundamental coefficients: e(u, v) = bi, (u,v) = 2(1 + 4u? + 4v?)~2, 


f (u,v) = bia(u,v) = 0, g(u, v) = bee(u, v) = 2(1 + 4u? + 4v?)~2, 


. Second fundamental form: II = 2(1 + 4u2 + 4v)~2 (du? + dv?). 


. Classification of points: e(u, v)g(u, v) = 4(1+4u?+4v7) > 0 implies that all 


points on S are elliptic points. The point (0, 0,0) is the only umbilical point. 


. Equation for the principal directions: uv du? + (v? — u?) dudvu + uv dv? = 0 


factors to read (udu + vdv)(v du — udv) = 0. 


. Lines of curvature: Integrate the differential equations, udv + v dv = 0, and 


uv du—v du = 0, to obtain, respectively, the equations of the lines of curvature, 
u2 + v? =r?, and u/v = cot 0, where r and 6 are constant. 


. Characteristic equation: (1 + 4u? + 4v?)\? — 4(1 + 2u? + 20?) (1 + 4u? + 


4u?)- 2A + 4(1 + 4u2 + 4v?)-! = 0. 


Principal curvatures: 1 = 2(1+-4u2+4v2)-2 and kg = 2(1+4u2+4v2)- 2. 
The paraboloid of revolution may also be represented by x = f(r,0) = 
(rcos@. rsin@,r?). In this representation the r- and 6-parameter curves are 


lines of curvature. 
Gaussian curvature: K = 4(1 + 4u? + 4v?)~?. 


Mean curvature: H = 2(1 + 2u? + 2u2)(1 + 4u2 + 4v?)-2. 
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5.1. DIFFERENTIAL CALCULUS 


5.1.1. LIMITS 


If lim f(a) = A < oo and lim g(x) = B < ov then 
=a =a 











(x))=A+B 





5 in, AD “ (if B 40) 





g(a) 

(x)]9™ = AP (if A > 0) 
: (f( (if h continuous) 
. If f(x) < g(a), then A< B 
. If A= Band f(x) < h(x) < g(a), then jim h(a) =A 


IDA nk w 
= 
B 
> 
SY 
8 
= 
II 
= 
— 
~~ 


EXAMPLES 





p 
EES =i (if ¢ > 0) 7. lim 
£200 r 
4. lim 2? jloga|? =0 (if p > 0) 
a2—0+ 


5.1.2 DERIVATIVES 


The derivative of the function f(x), written f’(), is defined as 


if the limit exists. If y = f(x), then oe = f'(x). The n™ derivative is 
dy"-) d (=) d’y 


(n) — = — —t 
y dr®-1 dx” 








— f(r), 
dx ~—s di ea 


The second and third derivatives are usually written as y” and y’”. Sometimes the 
fourth and fifth derivatives are written as y”) and y“), 

The partial derivative of f(x,y) with respect to x, written f,,(a,y) or of is 
defined as 


fa(t,y) = lim G13) 


278 CHAPTER 5. ANALYSIS 


5.1.3. DERIVATIVE FORMULAS 


Let u, v, w be functions of x, and let a, c, and n be constants. Appropriate non-zero 
values, differentiability, and invertibility are assumed. 








d d 
(a) = (a) =0 (0) = (z)=1 
d du d du —s dv 
(c) a (au) = as (d) 5 — a +vu)= ce + in 
d du dv d dw dv du 
(e) a (uv) = Oe “tr em (f) rh (wow) = ae a ae 
(2) d (4) _ldu udv _ v(du/dx) —u(dv/dz) 
e dx \v/  vdx ov2 dx v2 
d. 4.4 n—1 du 1 Gea 4, du » dv 
(h) = (u®) = nut @) ZF (u") = vu + (loge uu” 
d 1 du d 1 du 
a ee eee | wee 
@ = (vu) 2 Fa da (kK) G (loge ¥) = To 
d du d {1 1 du 
— (1 = (1 —-— — fo) = 
© Fog, 1) = (ogee) my £ (4) =- 5% 
(a) a 29 -— n du ( ' d ye 7 yr-t _ du 
dx \u" ut! dx - dx \um } ym "a Te 
d n,m n—1,,.m-1 dv 
(p) aa Vv ) v (nS + mu) 
d df du 
(q) de) au ae, 
d _ df du af (du 
2 m= fo + Sa (z) 
a3 do @u .@f du @u Bf (du\® 
© BUO-F gta a meta (=) 


() 4 = n oe n dy dtu " n\ d®v 
dx” nee 0 er 1) dx dx”—1 n a 


dx dy =e d?x dy dy ‘ 
_ = — d —_—_—_—_ — --—_ — 
mo dy (2) id dy? dx? dx 
_ Oy Fe 
(x) If F(a, y) = 0, then a ee and 
d2y (Fook? — 2Foy Fr Fy + FyyF2) 


dau? EF 
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(y) Leibniz’s rule gives the derivative of an integral: 





d g(a) I) On 
Hf matat) = o'@ntx. (0) F@)n(e. FO) + fF, tat 
da 2) O« 

f(#) f(x) 
(z) If 2 = x(t) and y = y(t) then (the dots denote differentiation with respect to t): 
ay it) Py _ a 
dx x(t)’ dx? (4)3 ~ 


5.1.4 DERIVATIVES OF COMMON FUNCTIONS 
Let a be a constant. 


f(z) f(x) | F(a) f'(a) f(x) 


—cscxcot x } csch; —csch x coth x 
sec xtan x : —sech x tanh x 
—csch? x ; a* lna 


«/|2| 





5.1.5 DERIVATIVE THEOREMS 


1. Fundamental theorem of calculus: — Suppose f is continuous on {a, 0]. 
zx 


(a) If G is defined as G(x) = | f(t) dt for all x in [a,b], then G is an 
anti-derivative of f on [a,b]. 


b 
(b) If F is any anti-derivative of f, then / f(t) dt = F(b) — F(a). 


2. Intermediate value theorem: If f(x) is continuous on [a,b] and if f(a) A 
f(b), then f takes on every value between f(a) and f(b) in the interval (a, b) 

3. Rolle’s theorem: If f(x) is continuous on [a, b] and differentiable on (a, b) 
and if f(a) = f (0), then f’(c) = 0 for at least one number c in (a, 6). 

4. Mean value theorem: If f(x) is continuous on [a,b] and differentiable on 
(a, b), then a number c exists in (a, b) such that f(b) — f(a) = (b— a) f'(c). 


> 
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5.1.6 THE TWO-DIMENSIONAL CHAIN RULE 


If x = x(t), y = y(t), and z = z(x,y), then 
dz Ozdx Ozdy 
Ge = Fx ae + Oy dt’ and 
dz Ozer dx (zdr dz dy 
onde | dt a (Saar cat) 
Oz d? dy | dy (= dy Oz =) 





(5.1.3) 


Oy dt? Oy? dt ° Oxdy dt 
If x = x(u,v), y = y(u, v), and z = z(x,y), then 
Oz  OzOx Oz Oy Oz  OzOx | OzOy 
oo anon © oN Au and Be Bebo Oude (5.1.4) 


Ifu = u(a,y), v = v(2, , and f = f(x,y), then the partial derivative of f with 


i; 
respect to u, holding v constant, written (at , can be expressed as 
Vv 


of af\ (dx Of\ (ay 
(r).= (5), Ge) * CG). (Ge), O19 
5.1.7 THE CYCLIC RULE 


If x, y, and z all ealeyis on one et ay \ (say, through f(x,y, z) = 0), then 
t 


v (0 Y)ax,z 
By), st) | = =~ (OF /Ox)y.2" oe 


and we find (this is the cyc ig r le) dy dz 
EXAMPLES nea 2 y 


1. Ifa+y+z=3 then 








2. If x? + yz =5 then 


(6) 2 ee Ox 2. Ox _ By?z 
(z,), tylz=5) —20(Z) +5%s=0 ° a) = 2a 
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5.1.8 MAXIMA AND MINIMA OF FUNCTIONS 


1. If a function f(x) has a local extremum at a number c, then either f’(c) = 0 
or f’(c) does not exist. 

2. If f’(c) = 0, f(x) and f’(x) are differentiable on an open interval contain- 
ing c, and 


(a) if f’’(c) < 0, then f has a local maximum at c; 
(b) if f’(c) > 0, then f has a local minimum at c. 
5.1.8.1 Two variables 


Suppose that extreme points of f(a,y) are desired. The stationary points are the 
solutions to 


f(x,y) = 9, fy(z,y) = 0. (5.1.8) 
For each stationary point we compute 


to determine the type of stationary point. 


1. If A> Oand fi > 0, then the stationary point is a local minimum. 
2. If A> Oand fra < 0, then the stationary point is a local maximum. 
3. If A < 0, then the stationary point cannot be an extermum. 


5.1.8.2 Three variables 


Suppose that extreme points of ®(x, y, z) are desired. The stationary points are the 
solutions to 


®,(2,y,z) =0, ®,(x,y,2) =0, ®.(x,y,z) =0. (5.1.10) 


For each stationary point we compute 





© © Dra Dry ®,, 
Ay =r, Ag= a = Ag=|®zy yy Bye). (6.1.11) 
me ve ®.. Dy. ®,. 


to determine the type of stationary point. 


1. If A; > 0, Ag > 0, and Ag > 0, then the stationary point is a local minimum. 
2. If Ay < 0, Ag > 0, and As < 0, then the stationary point is a local maximum. 


5.1.8.3 Lagrange multipliers 
To extremize the function f(a1,v2,...,%n) = f(x) subject to the m side constraints 
g(x) = 0, introduce an m-dimensional vector of Lagrange multipliers \ and define 
F(x, A) = f(x) + A"g(x). Then extremize F with respect to all of its arguments: 
OF of 7 Og OF 
= A — =0 d —=g9,=0. 31,12 
Ox; Ox; Ox; ; ss OX; Ji ( ) 


For the case of extremizing f(x, y) subject to g(x,y) = 0 (.e., n = 2 and m = 1): 
fe + Agr = 0, fy +Agy =9, and g=0. (5.1.13) 
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EXAMPLE Find points on the unit circle (given by g(x, y) = (w—1)°+(y—2)?—1 = 0) 
that are the closest to and furthest from the origin (the distance squared from the origin 
is f(z,y) = a? + y’). This is solved by creating, and solving, the three (non-linear) 
algebraic equations: 








Qe+2(ae—-1)=0, 2y+22(y—-2)=0, (#—1)?4+(y—2)? =1. 


The solutions are {2 = 1+ 1//5,y=2+2//5,\ =—1— V5} (furthest), and 
{x =1-1/V5,y =2—2/V5,\ = —1+ V5} (closest). 


5.1.9 LHOPITAL’S RULE 


If f(a) and g(a) are differentiable in a punctured neighborhood of point a, and if 
f(a) and g(a) both tend to 0 or oo as x — a, then 
/ 

jin 2) ioe (5.1.14) 

ra g(x) ra g(x) 
if the right-hand side exists. Sometimes, by manipulating functions, this rule can 
determine the value of the indeterminate forms {1°°, 0°, 00°, 0 - 00,00 — oo}. The 
rule can also be applied repeatedly. 

















EXAMPLES 
rf x— sing 1 1—cosxz i sin x cos x iL 
e — = = => — 
250 28 20 3x2 0 6 oe 6 
n n-1 = n—-2 ! 
ote 2 in ie OO = lm — =0 
x@%—oo e& @2—-+00 e © 00 er @—-+oco ef 
. x 1 tlna—ax+1 . Ing 
e lim = = li 
asl\a-1l Ina a1 (x—1)Ina vol 214Ing 
i alna . +1Inaz 1 
= bm —— = lim —— = - 
ran ae a oe zi2+Ing 2) 





5.1.10 COMMON LIMITS 


Assume a > 0 in the following. 























cv 1 1 = 1 
1. lim © =1 7 lim cosa 1 
x20 x 230 é 5 
2. im “—* = ina pe = 
z—0 x 30 = 
sinh 
3 lim mn eG 1 9 kk log, (1+ 2) Agee 
x2—0 x baa, = 
hs Vien et 10. lim 2* =1 
z>0 ; 
. tanha 11. im, x lInz= 
5. lim = 
ieee 12. lim « “Inz=0 
. tanaz 566 
6. lim —] 
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5.1.11 VECTOR CALCULUS 


1. Definitions of “div,” “grad,” and “curl” are on page 388. 
2. A vector field F is irrotational if V x F = 0. 


3. A vector field F is solenoidal if V - F = 0. 


A : — (2. 0. 0) 30 ae) a) 
4. In Cartesian coordinates, V = (4. By? 2) =15, + Ja, + ks. 


5. V-u= 322, 2 isa scalar while F- V = 372_, F:32 


i=1 Oz; Dz, San operator. 


6. If u and v are scalars and F and G are vectors in R3, then 


(a) V(u+v) = Vu+Vv 
(uv) = uVv + 0Vu 
() V(F+G) =VF+VG 
(F-G) =(F-V)G+(G- V)F+Fx (V x G)+Gx (V x F) 
(e) V- (uF) =u(V-F)+F- Vu 
-(Fx G)=G.(V x F)—-F-(V x G) 
(g) V x (uF) = u(V x F) + (Vu) x F 
(h) Vx (F+G)=VxFtVxG 
@) V x (Fx G) =F(V-G) —G(V-F) +(G- V)F— (F-V)G 
@ F-= (FIG 
(k) Vx (Vx F)=V(V-F)-V2E 
() V x (Vu) =0 
(m) V-(V x F) =0 
(n) V?(uv) = uV2u + 2(Vu) - (Vv) + vV2u 





7. ir=|r 





, ais a constant vector, and 7 is an integer, then 
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n—-2 


at n(n —2)r?~4*(r-a)r 
n(n + 3)r"-?r 
[r?a —2r- a)r)/r* 











d 7 1 dV2 dV3 
12. FIViVoVa] = | (SF) vova] + [vi (S2) va] + [vive (S2)]., 
where [V; V2V3] = Vi - (V2 x Vs) is the scalar triple product (see page 82). 
13. If A = A(t) and B = B(t) are matrices then 





d(AB) dA dB 
a “dt A dt 

d(A@B) dA dB 
(b) a =e B+A® ae 

d(A~') _,dA ._4 


5.1.12 MATRIX AND VECTOR DERIVATIVES 
5.1.12.1 Definitions 





1. The derivative of the row vector y = [ya YQ «+. ter with respect to the 
scalar x is D 
EE Oy2 Pu. (5.1.15) 
Ou Ox Ox Ox 


2. The derivative of a scalar y with respect to the vector x is the column vector 


OF E Oy Oy FF (5.1.16) 


Ox [Ox, Oa. “ Oan 
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. Let x bean x 1 vector and let y be am x 1 vector. The derivative of y with 
respect to x is the matrix 











Oyi = Oye Oym 

Ox, Ox, aad Ox, 
a Oy = Oye Oym 

dr. «(OO “8 Oa 
ee eee “ae i (5.1.17) 
Ox . . . 

Oy1 Oy2 Oy. 

OLn, Onn “"* Oday 


In multivariate analysis, if x and y have the same length, then the absolute 
value of the determinant of ou is called the Jacobian of the transformation 


OY 1 Y25-Yr) 
O62 Bo yecas8in) 


determined by y = y(x); written 

















. The Jacobian of the derivatives — a ; we. fe of the function d(21,....Un) 
with respect to 71,..., 2p, 18 called the Hessian FAA of ¢: 

64 ao ao ao 

Oxy Ox, Ox2 Ox 0x3 Ox, OX, 
ao a ao a 

is 0x2 0x4 0x2 Ox2 0x3 0x2 OLy, 
ao a ab ao 
OLn OX1 OLn OX2 OLn Ox3 Ox2 


. The derivative of the matrix A(t) = (a;;(t)), with respect to the scalar t, is the 
matrix ee = (42) : 





dt 


. If X = (a,j) is am x n matrix and if y is a scalar function of X, then the 
derivative of y with respect to X is (here, F,; = ee; ): 




















Oy Oy dy 
: a ce a, a 
a) 0 Th Oren 
xx | eee ers SO By a (5.1.18) 
: : re . 1l<i<m 
Oy Oy oy 1<j<n 
O@m1 OLm2 dd OF rn 


. If Y = (yj) isa p X q matrix and X is am x n matrix, then the derivative of 
Y with respect to X is 











oY oY oY 
Sy 0CtC Ce 
wy | we Bel ~ 
0x21 0222 eee OLan 
= = E;; ® ——. (5.1.19) 
Ox : : : : DD 2 Ox%; 
: : . : 1<i<m 
ay ay ay 1<j<n 
O&m1  OLm2 *"* Omn 











5.1.12.2 Properties 
1. If Y = AX—'!B, then 





(a) PY = —-AX~'B,.X~'B. 
fe) ig = = 
(b) $Y = —(X-1)TATH, BT(X-1)T, 
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2. If Y = AXB then 2 —- = AE;;B where Ei; = ee} has the same size as X. 


3. If Y = AX™B, hs Oy = BELA. 
4. fY = XTAX, then 


oY = EN,AX + XTAE;s. 
(b) S42 = AX ET + ATX Ei. 





5. Ify = VecY and x = Vec X (see page 103), then 
(a) IfY = AX, then & =I @ AT. 
(b) If Y = XA, then & = AQ]. 
(c) fY = AX—!B, en ® — —(X-1B) @ (X-1)TAT. 


6. The derivative of the determinant of a matrix can be written: 


ggg BOLL ee 
(b) If all of the components (x;;) of X are independent, then ae = 
|X] (Xo")F. 


(a) If Y;; is the cofactor of element y;; in 





7. Derivatives of powers of matrices are obtained as follows: 
OY _ r-l yk n—k— 
Ben, = Quk=0% ErsX - 
(b) If Y¥ = X-", then 2 =-—x-" ( sa APE) x7, 


(c) The n" derivative of the r™ power of the matrix A~!, in terms of deriva- 
tives of the matrix A, is 


2a (soo 2s Pia Bs) Ay (5.1.20) 


dx” a4! dg! tr! 
eed 1! 12 k 

















where P; = A" 5+ oo An and the summation is taken over all positive in- 





tegers (11, %2,.. ip. distinct or otherwise, such that ~ tim = 7. 
Setting n = r = 1 results in 
dA-+ dA 
=-A!—A7}, (5.1.21) 
., dx dx 
8. Derivative formulas: 
Oz = OLOX 
Ifz= , then — = ——. 
(a) If = a{y(x)), then 5 = 
(b) If X and Y are matrices, then (2) = ae 


Ix 
(c) If X, Y, and Z are matrices of ede m xX 


BY) < OX (7, @Y) + (Ip @ X)% 


n,n xX v, and p x q, then 
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. — ‘ . OAx 
9. Differentiation with respect to a vector x. (Here A is constant.) Ox = Aand 
x 


y (a scalar or a vector) oy (where x is a vector) 


x! I 





10. Differentiation with respect to a matrix X. (Here {a,b, A, B} are constants, 
Y =Y(X), and Z = Z(X).) 


y (a scalar, vector, or matrix) & (where_X is a matrix) 


YZ YSZ4+R42 
AXB ATBT 
a’ XTXb X(ab’ + ba’) 
al X'Xa 2Xaa™ 
a’ X'™CXb CTXab' + CXba™ 
a’X'OXa (C +C™)Xaa! 
(Xa+b)'C(Xa+b) (C+ C")(Xa+ b)a? 





11. Differentiation of specific scalar functions with respect to a matrix X. 
(Here {A, B} are constants.) 


y (a scalar) # (where X is a matrix) 


tr(X) I 
tr(ATX), tr(X A‘), tr(AX7), or tr(X7TA) A 
tr(AXB) ATBT 
tr(X AX") X™(A+ A?) 


tr(XTAX) (A+ A™)X 
tr(XTAXB) AXB+A'XB" 
tr(e*) ex" 
det(X) or det(X*) det(X) (X~*) 
det(AX B) det(AX B)(x—1)? 


log |X| (x) 
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5.2 DIFFERENTIAL FORMS 


Let dx;(-) be the function that assigns a vector its k"" coordinate; for the vector a = 
(@1,.--,@k,---,Qn) we have dx;,(a) = ax. Geometrically, dx;,(a) is the length, 
with appropriate sign, of the projection of a on the k" coordinate axis. If the { F;} 
are functions then the following linear combination of the functions {da } 


Wx = F\(x) dx + F(x) dxz +--+ + Fy(x) dx (5.2.1) 
is a new function w, that acts on vectors a as 
Wy (a) =F, (x) dx (a) + Fo (x) dx (a) ata ale F(x) dixy,(a). (5.2.2) 


Such a function is a differential 1-form or a 1-form. For example: 


1. Ifa = (—2,0,4) then dx, (a) = —2, dx2(a) = 0, and dx3(a) = 4. 

2. Ifin R?, wy = wey) = x? dx + y” dy, then we,y)(a,b) = ax? + by? and 
w1,—3) (a, b) =at 9b. 

3. Note that V, f, the differential of f at x, is a 1-form with 


Val (a) = (x) drs (a) + 22 (x) doa(a) + 2 (x) desta) 
Ly vg L3 
= wai + oH (x)as + oH xa 


5.2.11 PRODUCTS OF 1-FORMS 


The basic 1-forms in R® are dx,, dx2, and dx3. The wedge product (or exterior 
product) dx, /\ dxz is defined so that it is a function of ordered pairs of vectors 
in R*. Geometrically, dx, A dx(a,b) is the area of the parallelogram spanned by 
the projections of a and b into the (a1, x2)-plane. The sign of the area is determined 
so that if the projections of a and b have the same orientation as the positive 7; and 
X2 axes, then the area is positive; it is negative when these orientations are opposite. 
Thus, ifa= (a1, a2, az) and b = (bi, bo, bs), then 


dx, \ dx(a, b) = det Ee | = a,b = agb,, (5.2.3) 
a2 bo 
and the determinant automatically gives the correct sign. This generalizes to 


= da; (a) dx; (b) = a, by 
dx; \ dx;(a,b) = det bs (a) de, ‘| = det |<: | : (5.2.4) 


1. If f and g are real-valued functions and 

(a) If w and yz are 1-forms, then fw + gy is a 1-form. 

(b) If w, v, and ys are 1-forms, then (fw + gv) A\p=fwApwtgvAu. 
4. dx; dx; (b, a) = —dzx; A dx; (a, b) 
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5.2.2 DIFFERENTIAL 2-FORMS 


In R°, the most general linear combination of the functions dz; \ dx; has the form 
ci dx2 \ daz + co daz \ dx, + cg dx, A dxo. If F = (Ff), Fo, F3) is a vector field, 
then the function of ordered pairs, 


Tx (a, b) =F, (x) dx» /\ dx3 + F(x) dxr3 N dx, + F(x) dx, /\ dx (5.2.5) 
is a differential 2-form or 2-form. 
EXAMPLES 


1. For the specific 2-form 7 = 2dx2 A dr3 + dx3 A da1 +5 dai A deo, if a = (1, 2,3) 
and b = (0, 1,1), then 


2 1 3 41 1 0 
Tx(a,b) = 2 det E i] +aet ki ‘| + 5 det E ] 


a2: (<1) 441- (<1) 45-(1)=2 





i jk 
independent of x. Note thata x b = det}1 2 3) = (—1,-1,1), and so 
0 1 1 


Tx(a,b) = (2,1,5)- (a x b). (Of course, this only works in 2 dimensions since 
cross-products are not defined in higher dimensions.) 

2. When changing from Cartesian coordinates to polar coordinates, the element of area 
dA can be written 


dA = dx dy 
= (—rsin 6 d0 + cos@ dr) A (r cos6 d6 + sin @ dr) 
= —r’ sin 0 cos 0 (d0 A d0) + sin @ cos @ (dr A dr) (5.2.6) 
—rsin’ 0 (d0 A dr) + rcos’ 0 (dr A d@) 
=rdrAdé. 


5.2.3 THE 2-FORMS IN RY 


Every 2-form can be written as a linear combination of “basic 2-forms.” For example, 
in R? there is only one basic 2-form (which may be taken to be da; (A diz) and in 
R® there are 3 basic 2-forms (possibly the set {dx A dx2, dx2 A dx3, dx3 A dx1}). 
The exterior product of any two 1-forms (in, say, R”) is found by multiplying the 1- 
forms as if they were ordinary polynomials in the variables dx1,...,dx,, and then 
simplifying using the rules for dx; A dx;. 


EXAMPLE Denoting the basic 1-forms in R® as dz, dy, and dz then 
(ada + y” dy) A (dx + a dy) = x (dx A dx) + y? (dy A dz), 
+ a” (dx A dy) + ay? (dy A dy), 
=0-y? (dx A dy) + x? (dx A dy) +0, 
= (x? — y”) dx Ady. 


(5.2.7) 
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5.2.4 HIGHER DIMENSIONAL FORMS 


The basic 3-form dx; A dx2 A dx3 represents a signed volume: 


ay by 
dx, \ dxz \ du3(a,b,e) = det Jag bo C2 (5.2.8) 
az 63 ¢3 


which is a 3-dimensional oriented volume of the parallelepiped defined by the vectors 
a, b, and c. 
The basic p-forms in R”, with p > 1, are 
dx kK, \ dikes Ave A dxp, (a1,..-, Ap) = det (daz, (a;))i=1 rer Dp. (5.2.9) 
j=1,...,p 
The general p-forms are linear combinations of the basic p-forms. 
in cee<ip Fits sip Wi, N-+ Ndz%,, 
where 1 < i, < nfork =1,...,p. This sum has (7) distinct non-zero terms. 
2. If w? is a p-form in R” and w? is a q-form in R”, then 
wP A wt = (-1)P9 wt Aw? 
3. A basic p-form with a repeated factor is zero. Thus if p > n, then any p-form 
is identically zero. 
4. Stoke’s Theorem:  [,, dw = Jy,, where w is a differential form. 


1. The general p-form can be written w? = }> 


5.2.5 THE EXTERIOR DERIVATIVE 


The exterior differentiation operator is denoted by d. When d is applied to a scalar 
function f(x), the result is a 1-form df = Vx f ot day +e+-+ fb dx,,. For the 


1-form wt = fi dx +---+ fp dx, the exterior derivative is dw’ = (df,) A dz, + 
--+ + (df,) A da. This generalizes to higher dimensional forms. 


EXAMPLE 
If Whi coat = v1.02 dx, + (27 + x3) dra, then dw’ is given by 
du’ = d(x1r9 dx + (xj + £3) dr2) 
= (x2 dx, + 21 dx2) A dx + (221 dxy + 2x2 dx2) A dre 


= 71 dx mx dx2. 


5.2.6 PROPERTIES OF THE EXTERIOR DERIVATIVE 


1. If fi(ai, 22) and fo(x1, x2) are differentiable functions, then 


O 
df, A dfz = det pe dx, \ dx2. (5.2.10) 
O(a1, x2) 
2. Ifw? and w! represent a p-form and a q-form, then 
d(w? A wt) = (dw?) A wt + (—1)P4w? A (dw’). (5.2.11) 


3. If w” is a p-form with at least two derivatives, then d(dw?) = 0. 
e d(dw°) =0 is equivalent to curl(grad f) = V x (Vf) =0. 
e d(dw') =0 is equivalent to div(curl F) = V - (VF) = 0. 
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5.3 


5.3. 


1 DEFINITIONS 
The following definitions apply to the expression J = i f(a) dx 


1. The integrand 
2. The upper limit 
3. The lower limit 


4. 


1. 
2. 


io) 


4. 


I 


INTEGRATION 


is f(x). 

is b. 

is a. 

is the integral of f(x) from a to b. 


It is conventional to indicate the indefinite integral of a function represented 
by a lowercase ane by the pig teers uppercase letter. For example, F(x) = 
Je f(t) dt and G(x) = J” g(t 


constant are also wre oo of f(x). We have the following notation: 


J f(a) da 
J. f(x) de 


: fo f(x) dx 


So f(a) dx 


: C f(a) dx 


. Improper integral 


t) dt. Note that all functions that differ from F'(x) by a 


indefinite integral of f(a) (also written [” f(t) dt) 


definite integral of f(x); for a continuous function de- 


“ys fae ke 6-0) 


definite integral of f(a), taken along the contour C 





fined as im (5 


R 
defined as Him [ f(a) dx 
Roo Jaq 


defined as the limit of ae f(a) dx as R and S inde- 


pendently go to oo 
integral for which the region of integration is not 


bounded, or the integrand is not bounded 


. Cauchy principal value 


(a) The Cauchy principal value of the integral fe f(a) dx, denoted 
b c—eE b 

f f(a) da, is defined as lim ( f(x) dx +/ f(z) is) , as- 
a e>0+ a cte 


suming that f is singular only at c. 
(b) The Cauchy principal value of the integral ts f(a) da is defined as the 
R 


limit of | | f(a) dx as R > oo. 
-R 


. If, at the complex point z = a, f(z) is either analytic or has an isolated sin- 
ee then. the Hoe of f(z) at z = a is given by the contour integral 


Res ¢( fla 
sehen 


= oat $e F( 


€) dg; where C is a closed contour around a in a positive 
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5.3.2 PROPERTIES OF INTEGRALS 


Indefinite integrals have the properties (here F' is the anti-derivative of /f): 


i, . + ae dz=af f(x)dx+b f g(x) dz linearity 
2. { f(x)g(x) de = F(z)g(x) — [ F(e)g'(x) da integration by parts 
3. f f(g(x))g'(«) dz = F(g(a)) substitution 
4. ha ) dx = 4F (ax + b) 

5. If f(a) is an odd function and F'(0) = 0, then F'() is an even function. 

6. If f(a) is an even function and F'(0) = 0, then F(x) is an odd function. 

7. If f(z) has a finite number of discontinuities, then the integral [ f(a) dx is 


the sum of the integrals over those subintervals where f(a) is continuous (pro- 
vided they exist). 


8. Fundamental theorem of calculus: If f (a) is bounded, and integrable on [a, 6], 
and there exists a function F(a) such that F’(a) = f(x) fora < x < b then 
fora<a<b 


x 
x 


i f(z) dx = F(a) |, = F(x) — F(a) (5.3.1) 


a 


a 
Definite integrals have the properties: 


(a) f° f(x) dx =0 


a 


(b) f° f(z)dx =— Jj, f(x) dx 

() [2 f(x) dx + f° f(x) dx = f° f(a additivity 
(d) f’[cf(x) + dg(a)|dx =cf? f(x) dx +d a g(x) dx linearity 
5.3.2.1 Convergence tests 


1. If ci | f (x)| dx is convergent, and f is integrable, 

then i. f (x) dx is convergent. 
2. IfO< f(a x), f° g(x) dx is convergent, and f is integrable, 

then rh f(x) dx is convergent. 
3. If0 < g(x) < f(x) and i. g(x) dx is divergent, then ths f (x) dx is divergent. 


The following integrals are often used with the above tests: 


cc dx ag! 
(a) i a= gd ee converge when p > 1, and diverge when p < 1. 
log x)? 1 oP 


1 
d 

(b) | - converges when p < 1, and diverges when p > 1. 
0 a 
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5.3.2.2 Double Integrals 
1. Bounds on Integration: If m < f(x,y) < M ina domain D of area A, then 


mA < // f(a, y) da dy < MA. 
D 
2. Integration of Inequalities: If a(x, y) < f(x,y) < b(x, y) ina domain D, then 
// a(x, y) da dy < // f(x,y) dx dy < // b(a, y) dex dy. 
D D D 


i LF (o,y)| de dy. 
D 


4. Mean value theorem: If f(x,y) is continuous in a domain D of area A, then 
there exists at least one point (%, 7) in D such that 


f(x,y) dx dy = f(@,¥) A. 
D 
5. Area of a surface: If a surface is defined parametrically by the equations 
{x = x(u,v),y = y(u,v),z = z(u,v)} for values of (u,v) defined in Dy», 
then the area of the surface is 


Area =| VEG — F2 dudv where 
Duy 
pe dw 2 . ay : az 2 
Ou Ou Ou 
_ on\” 7 dy\* my Oz 
~ Lav Ov Ov 


_ O02 Ox Oy oy Oz Oz 
~ Qudv | Judv | dudv 
6. Change of Variable: Let x(u,v) and y(u,v) be continuously differentiable 


aes that map one-to-one the domain D,,, in the wv-plane to the domain 
Dy in the ry-plane. Let f(x, y) be a continuous function in D,,. Then 


If. f(x,y) da dy =/[ 4 v),y(u,v)) |J(u,v)| dudv (5.3.2) 


where ‘ (u, v) is the Jacobian of the mapping of D,,, onto Dzy: 


O(a, y) Qu Ou Ox Oy Ox Oy 
J = = Ww vv) = —  — 5.3.3 
ae) O(u, v) ae Oudv  Ovodu ( ) 
e Not that the Jacobian of the mapping from Cartesian Coordinates (x, y) 
to polar coordinates (r, 6) via {2 = rcos0,y = rsin 9} is J(r,0) =r. 





3. Absolute value theorem: a f(x,y) dx dy| < 
D 

















EXAMPLE A circle of radius R in Cartesian coordinates has area 
A=f he fy? <p? 1 dx dy. Changing to polar coordinates this becomes 


A= fe" fF (1x J(r,0)) dr do = ( sl d0) he rdr) = (2) (#) _ oR? 
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5.3.3 APPLICATIONS OF INTEGRATION 


1. Using Green’s theorems, the area bounded by the simple, closed, positively 


oriented contour C is 


area = ¢ xdy = - $ yde. (5.3.4) 
c c 


2. Arc length: 


(a) oy Saal dato = ft, 
es 
(b) s= [V6 \/ ¢2 +2 dt forxz = ¢ = 


@s=f- \r +($) ae 4 L+ (5) eae f (0). 





3. Surface area for surfaces of revolution: 


@) A=2n f° fl) VIFF RP ee 


when y = f(a) is rotated about the x-axis. 


(b) A=2r [ ay/1+ (f'(a))? dy 
Y1 


when y = f() is rotated about the y-axis and f is one-to-one. 


te . . 
(@) A=2n | wry o? + yw? dt 
t 
; for « = ¢(t), y = w(t) rotated about the z-axis. 


ta = s 
(d) Aaa | ov o? + Wi? dt 
ty 
for « = ¢(t), y = w(t) rotated about the y-axis. 


2 
(©) A=2n [ rsin dy/r?2 + (2) dd 


for r = r(@) rotated about the x-axis. 


p2 dr 
(f) Anan f rcos@ + (2) do 


for r = r(¢) rotated about the y-axis. 


4. Volumes of revolution: 


LQ 
(a) V= rf f?(a) dx for y = f(x) rotated about the z-axis 
xy 


2 
(b) V= vf a? f(x) dx for y = f(a) rotated about the y-axis 
Ly 
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y2 
(c) V= rf g°(y) dy for x = g(y) rotated about the y-axis 
Y 


te . 
(d) V=n w’odt for x = $(t), y = W(t) rotated about the x-axis 
ty 


te 

(ec) V=r by) dt for x = $(t), y = W(t) rotated about the y-axis 
2 adi dr 

(f) varf sin* d ae ee do 


for r = f(@) rotated about the x-axis 
p2 d 
(g) varf costo (4 sind ~rcos6) do 
1 do 


for r = f(@) rotated about the y-axis 


5. The area enclosed by the curve x°/¢ + y/¢ = a®/°, where a > 0, c is an odd 
2ea? [I (§)]" 





integer and b is an even integer, is A = 


5 Te) 


5.3.4 INTEGRAL INEQUALITIES 


b 
1. Schwartz inequality: / lfgl< 





2. Minkowski’s inequality: 


b 1/p b 1/p b 1/p 
(/ +0") <(f ur “( vr) gen =. 


3. Holder’s inequality: 


b b 1/p b 1/q 
[ivis|f ur / er when 2+1=1,p>1,andq>1. 


4, | f° F(x) da| < [? |f(x)| dx < (nae | f(2)1) (b — a) assuming a < b. 


b b 
5. If f(a) < g(x) on the interval [a, }], then / f(a) da < / g(a) da. 
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5.3.5 METHODS OF EVALUATING INTEGRALS 
5.3.5.1. Substitution 


Substitution can be used to change integrals to simpler forms. When io trans- 
form a = mee ) is chosen, the integral J = [ f(t) dt becomes I = f[ f(g(x)) dt = 
[fg (x) dx. Several precautions must be taken when using — 


1. Make the substitution in the dx term, as well as everywhere else in the integral. 


2. Ensure that the function substituted is one-to-one and differentiable. If this is 
not true, then the integral must be restricted in such a way as to make it true. 


3. With definite integrals, the limits should also be expressed in terms of the new 
dependent variables. With indefinite integrals, it is necessary to perform the 
reverse substitution to obtain the answer in terms of the original independent 
variable. This may also be done for definite integrals, but it is usually easier to 
change the limits. 


EXAMPLE Consider the integral 


4 
x 
t= [ ae (5.3.5) 


for a £ 0. Choosing the substitution « = |a| sin 6 we find dx = |a| cos @ d@ and 


Va? — a? = Va? — a? sin? 6 = |a| V1 — sin? 6 = Jal |cos 6]. (5.3.6) 


Note the absolute value signs. It is important to interpret the square root radical con- 
sistently as the positive square root. Thus V2? = jal. 

Note that the substitution chosen is not a one-to-one function, that is, it does not 
have a unique inverse. Thus the range of 9 must be restricted in such a way as to make 
the function one-to-one. In this case we can solve for 0 to obtain 





(a = (5.3.7) 


|a| 


This will be unique if we restrict the inverse sine to the principal values -5 <0 < 
Thus, the integral becomes (with da = |a| cos 0 d@) 


NIA 


I= | ——  |a|cos@ dé. (5.3.8) 
cos 6| 


For the range of values chosen for 0, we find that cos @ is always non-negative. Thus, 
removing the absolute value signs from cos @ results in 


T= at [ sin‘ 0.8. (5.3.9) 


Using integration formula #283 on page 324, and simplifying, this becomes 


4 4 4 
r=-5 sin® cos — = sin cos +0 +0, (5.3.10) 


5.3. INTEGRATION 297 


To obtain an evaluation of J as a function of x, we must transform variables from 0 
to x. We have 
2 Ee 


cos6é =+V1—-sin?6 = 44/1 -— =4+>—_—_.. (5.3.11) 


a? |a| 




















Because of the previously recorded fact that cos @ is non-negative for our range of 0, 
we may omit the + sign. Using sin? = 2/|a| and cos? = Va? — x?/ |a| we can 
evaluate Equation (5.3.10) to obtain the final result, 


4 3 2 4 
t= | see --Gve 2 - Se + sin +0. (5.3.12) 
a* —2z@ 








5.3.5.2 Partial fraction decomposition 


An integral of the form f R(«) dx, where R is a rational function, can be evaluated 
in terms of elementary functions. The technique is to factor the denominator of R 
and create a partial fraction decomposition; each resulting sub-integral is elementary. 


<a 2 _ 
EXAMPLE Consider J = cl A ca da. This can be written as 
a? —52+6 


a—A4 2 1 
r= [ (2+ 5745) a= f (2+ 5-—5) dx 


which can be readily integrated J = x? + 2In(x — 2) — In(a — 3). 


5.3.5.3 Useful transformations 
The following transformations may make evaluation of an integral easier: 
1. ff (x, Vx? +a?) dx =a f f(atanu, asec u) sec? udu 
when u = tan~+ = anda > 0. 
2. ff (x, V2? —a?) dx =af f(asecu,atanu) secu tan udu 


when u = sec”! = anda > 0. 


Jf (@, Va? — 2?) dx =af f(asinu, acosu) cos udu 


- 








when u = sin7! <= anda > 0. 
4. f f(sina)d w=2ff (2s >) 74 To when z = tan §. 
5. f f(cosz) ae =2f 1 (158) oie Ge when z = tan §. 
6. f f(cosx) dx = — f fi Oe when v = cosa. 
1. { fisue)de =f fu) Ss when u = sin 2. 
8. f f(sinz, cosa) da = f f (u u, V1 — u?) Sites when u = sin z. 
9, { i (sine, cosa) de 2 f f (3.455) re when z = tan §. 
10. f°, f(u) da = f°. f(a) da when u = x — S- “i _ where {a;} is any 


Le =i Ce 
j=l 7 


sequence of positive constants and the {c,;} are any real constants whatsoever. 
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Several transformations of the integral hs f(x) dx, with an infinite integration 
range, to an integral with a finite integration range, are shown: 





5.3.5.4 Integration by parts 


In one dimension, the integration by parts formula is 


ic dv = uv — fe du for indefinite integrals, (5.3.13) 


b 
/ udv = uv 
a a 


When evaluating a given integral by this method, u and v must be chosen so that the 
form { u dv becomes identical to the given integral. This is usually accomplished by 
specifying u and dv and deriving du and v. Then the integration by parts formula 
will produce a boundary term and another integral to be evaluated. If u and v were 
well chosen, then this second integral may be easier to evaluate. 


EXAMPLE Consider the integral 


I= f wsinzdz, 


Two obvious choices for the integration by parts formula are {u = x, dv = sin x dx} 
and {u = sin x, dv = x dx}. We try each of them in turn. 


b b 
_ / v du for definite integrals. (5.3.14) 





1. Using {u = x, dv = sina dx}, we compute du = dz and v = f dv = f sinzdx = 
—cos x. Hence, we can represent J in the alternative form as 


I= fesined = fudo=w— fvdu=—xeosr+ f cosas, 


In this representation of J, we must evaluate the last integral. Because we know 
f cosa dx = sin x the final result is J = sin x — x cos x. 

2. Using {u = sin x, dv = x dx} we compute du = coszdaandv = [du = f xdx 
x” /2. Hence, we can represent J in the alternative form as 


x x 
I= f xsinede= f udv=w [odu= sine — fF cosedz, 


In this case, we have actually made the problem “worse” since the remaining integral 
appearing in I is “harder” than the one we started with. 
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EXAMPLE Consider the integral 


I= f e*sinede, 


We choose to use the integration by parts formula with wu = e” and dv = sinzdz. 
From these we compute du = e” dx and v = f dv = f sinadx = — cosa. Hence, 
we can represent J in the alternative form as 


I= fetsinede = fudv=w— [vdu=-e* cose + | e coswdr 


If we write this as 
IT=-e* cosx+J with 5 Je cos x dx, (5.3.15) 


then we can apply integration by parts to J using {u = e*, dv = cosxdx}. From 
these we compute du = e* dx andv = f[ dv = [ cosadx = sinz. Hence, we can 
represent J in the alternative form as 


j= [ cosnde = f ude =w [edu=e' sine [esinede 


If we write this as 





J=e' sing —I, (5.3.16) 
then we can solve the linear Equations (5.3.15) and (5.3.16) simultaneously to deter- 


mine both J and J. We find 


I= f e*sinede = 5 (€* sin x — e* cose), and 
; (5.3.17) 
j= [ cosas =5 (e" sinz +e" cosz). 


5.3.5.5 Extended integration by parts rule 


The following rule is the result of n + 1 applications of integration by parts. Let 


nla) =f o(a)ax, gale) = f av(e)dz, ..., gamle) = f dmr(a) de. 


(5.3.18) 
Then 


if f(a)g(x) de = f(a)g(a) — f'(a)go(a) + f"(a)gs(a) —..- 


+ (=1)"f (@)gn4i(x) + (-1)""1 : f°) (a) gn4i(a) dx. (5.3.19) 
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5.3.6 TYPES OF INTEGRALS 


5.3.6.1 Line and surface integrals 


A line integral is a definite integral whose path of integration is along a specified 
curve; it can be evaluated by reducing it to ordinary integrals. If f(a, y) is continuous 
on C, and the integration contour C is parameterized by (¢(t), w(t)) as t varies from 


a to b, then 
[ fle,y)ax = f ") (w,v@) 6 (t) dt, 


[few dy = [s (ow.v@) w’ (t) dt. 


In a simply connected domain, the line integral J = ie X dx+Y dy+Zdzis 
independent of the closed curve C if and only if u = (X,Y, Z) is a gradient vector, 
u = grad F (that is, F, = X, Fy, = Y, and F, = Z). 


(5.3.20) 


Green’s theorem: Let D be a domain of the xy plane, and let C be a piecewise 
smooth, simple closed curve in D whose interior R is also in D. Let P(x, y) and 
Q(a, y) be functions defined in D with continuous first partial derivatives in D. Then 


f (Pav + Qdy) = If (3 at =) dx dy. (5.3.21) 


This theorem may be written in the two alternative forms (using u = P(x, y)i + 
Q(x, y)j and v = Q(x, y)i— P(a,y)j), 


fur ds = ji curludxdy and fv ds =) div vdz dy. (5.3.22) 
c c 
R R 


where rf represents the tangent vector and ,, represents the normal vector. The first 
equation above is a simplification of Stokes’s theorem; the second equation is the 
divergence theorem. 


Stokes’s theorem: Let S be a piecewise smooth oriented surface in space, 
whose boundary C is a piecewise smooth simple closed curve, directed in accor- 
dance with the given orientation of S. Let u = Li+ Mj + Nk be a vector field 
with continuous and differentiable components in a domain D of space including S. 
Then, {, ur ds = ff (curlu) - ndo, where na unit normal vector on S, that is 

Ss 


[ae (= - =) dy dz 
z 


aL ON aM AL 
(2 A oe) a dx +(F- a cn) dea (5.3.23) 
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Divergence theorem: Let v = Li+ Mj-+ Nk be a vector field in a domain D 
of space. Let L, MW, and N be continuous with continuous derivatives in D. Let S 
be a piecewise smooth surface in D that forms the complete boundary of a bounded 
closed region R in D. Let n be the outer normal of S with respect to R. Then 
[fundo = fff div vdz dy dz, that is 
Ss R 


[feuds Made de +N dody 


Ss 
=I I} (+5 ay +2) dxdydz. (5.3.24) 


If D is a three-dimensional en with boundary B, let dV represent the vol- 
ume element of D, let dS represent the surface element of B, and let dS = ndS, 
where n is the outer normal vector of the surface B. Then Gauss’ formulas are 


/| Sa ae or 
// vxadv = ffasxa=[finxayas and (5.3.25) 
D B B 

If al ods, 


where ¢ is an arbitrary scalar and A is an arbitrary vector. 

Green’s theorems also relate a volume integral to a surface integral: Let V be 
a volume with surface S, which we assume is simple and closed. Define n as the 
outward normal to S. Let ¢ and w be scalar functions which, together with V7¢ and 
Vw, are defined in V and on S. Then 


1. Green’s first theorem states that 


Ow 9 
—dS= : . 2. 
fe i S | (6V w+Vo¢ Vv) dV (5.3.26) 


2. Green’s second theorem states that 


/ (oS = vse) as =| (V7 — pV7¢) dV. (5.3.27) 
Ss Vv 
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5.3.6.2 Contour integrals 


If f(z) is analytic inside a simple closed curve C (with proper orientation), then 


1. The Cauchy—Goursat integral theorem is $, f(€) dé = 0. 
2. Cauchy’s integral formula is 
ee! £(§) 7) ¢ 7) 
fe) = 55 p Fae and i) =5— Ena? 


(5.3.28) 





nl £(©) 
In general, f'") (z) = x ——_~__ dE. 
elg=syr" 
3. Use of residues 
(a) If f(z) is written as a Laurent series about the point zo 
= a2 Aj 


F(z) => Ol 2—29)" =< +5—— ag + 


(z — 20) 





+ag+ai(z—z0)+..., 
Zz — £0 
n=— Co 


(5.3.29) 
then the residue of f(z) at z = zo, denoted Res (zo), is the value a_y. 
(b) Residue theorem: For every simple closed contour C enclosing a fi- 


nite number of (necessarily isolated) singularities { 21, z2,..., Zn} of a 
single-valued analytic function f(z) continuous on C, 
i n 
— dé = Res f(z 5.3.30 
ai p fea D Res (a) (5.3.30) 
EXAMPLE Consider the integral i 
20 
dé 
T= — 3.31 
/ 2+ cosé Rasy) 
Change the variable from 6 to z via z = e’®, so that d0 = —iz~! dz. Since cos@ = 
$ (z + a"), Equation (5.3.31) becomes 
—4 =1 —27 
I =¢ pete ae = ¢ a ay, (5.3.32) 
c2t+5(zt21) Jowr+4az+l 


As @ varies from 0 to 27, z traces out a circle of radius one in the clockwise sense. 
Hence, the contour C is the unit circle. 
The quadradic in the denominator factors as z* + 4z + 1 = (z —a,)(z—a_), 
—2i 
where a4 = —24 J3. Hence, J = ¢ 
: Je (z— a4)(z — a) : 
the integrand (z = a+) only z = a is inside the unit circle. The Laurent series of the 
integrand about the pole z = a+ is 


= -(——) : + h(z), (5.3.33) 


(2—ay)(2—a-) 





dz. Of the two poles in 




















a+ — A a= Ay 
where h(z) = ( — ) + is analytic at z = a+. Hence, the residue of the 
Bias Toy 2-—-A. 
. . oa: — De — ae . . . 7 
integrand at a, is Ress(a+) = se ) = ek Using this in the residue theorem 


(Equation (5.3.30)) results in 


f= f iide= ori Ress (2) 91 (=) = = 
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5.3.7 VARIATIONAL PRINCIPLES 


If J depends on a function g(x) and its derivatives through an integral of the form 
Jig] = [ F(g,9',...) dz, then J will be stationary to small perturbations (i.e., first 
derivative zero) if F’ satisfies the corresponding Euler-Lagrange equation. 


Function Euler-Lagrange equation 


as, 
dx 


(x, Y; y’, ie y) dx 


n d™ 
(=) dz” 


Jf ja (84)" +b (S4)" + cu? + 2ful de dy 


R 





5.3.8 CONTINUITY OF INTEGRAL ANTI-DERIVATIVES 
Consider the following different anti-derivatives of an integral 
2tan~! (3 tan 4) 


F(x) = f $0) eg =| 3 jee 2tan~*(3sinxz/(cosa + 1)) 


5 — 4cosa —tan~!(—3sin2/(5cosz — 4)) 

2tan~! (3tan$) +27r|2 +4] 

where |-| denotes the floor function. These anti-derivatives are all “correct” because 

differentiating any of them results in the original integrand (except at isolated points). 

However, if we desire aa f(x)dx = F (4m) — F(0) to hold, then only the last 

anti-derivative is correct. This is true because the other anti-derivatives of F'(a) are 

discontinuous when « is a multiple of 7. 

In general, if F(z) = [” f(t) dt is a discontinuous evaluation (with F'(a) dis- 

continuous at the single point x = 6), then a continuous evaluation on a finite interval 
is given by f° f(x) dx = F(c) — F(a), where 


F(z) = F(a) — F(a) + H(a — b) | lim F(x) — lim Fe) (5.3.34) 
xz—b— a—b+ 
and where H(-) is the Heaviside function. For functions with an infinite number of 


co 
eo 
discontinuities, note that SS H(a—pn—q)= 4 ; 


n=1 


304 CHAPTER 5. ANALYSIS 


5.3.9 ASYMPTOTIC INTEGRAL EVALUATION 
1. Laplace’s method: If g(ao) 4 0, f’(ao) = 0, f” (ao) < 0, and \ — oo, then 


xot+e 7. 
Teo (A) = / g(x)e*F dx ~ g(x) aa exp [720 +o... 


o—€ 
(5.3.35) 
Hence, if points of local maximum {;} satisfy f’(x;) = 0 and f’"(2;) < 0, 
then [°° g(x)e*F@ da ~ YY, Ix,(A). 
2. Method of stationary phase: If g(a%o) 4 0, f(%o) 4 0, f’(ao) = 0, f" (ao) F 
0, and A — oo, then 


Lote : : 
/ g(x)eF ® da ~ g(x0) FIAT exp} iA a) + 7 sgn J"(x0) ee 
3. Power Laplace Integral: If g(a) # 0, f(a) > 0, f’(ao) = 0, f’” (wo) < 0, 
and \ — ov, then 
rote y) 1 
[sete] ae ~ a(e0)y) samy LACe0)] + ---- 


5.3.10 TABLES OF INTEGRALS 


Even with an extensive integral table it is uncommon to find a specific desired inte- 
gral. Often a transformation is required. Simple transformations, such as substitu- 
tions (e.g., y = ax) are employed, almost unconsciously, by experienced users. 

We adopt the following conventions in the integral tables: 


. A constant of integration must be included with all indefinite integrals. 

. Angles are measured in radians. 

. Inverse trigonometric and hyperbolic functions represent principal values. 

. Logarithmic expressions are to base e, unless otherwise specified, and are to 

be evaluated for the absolute value of the arguments involved therein. 

5. The natural logarithm function is denoted as log x. 

6. The variables n and m usually denote integers. The denominator of an expres- 
sion is not allowed to be zero; this may require that m 4 0 orm # n or some 
other similar statement. 

7. When inverse trigonometric functions occur in the integrals, be careful with 

substitutions. There is often no problem for positive arguments of inverse 

trigonometric functions. However, if the argument is negative, special care 
must be used. Thus, if wu > 0 then 


1 
sin-tu=cos-tVW1—u2 =csc !—=.... 


Uu 


BWN re 


However, if wu < 0, then 


Pa ue 7 1 
sinstu=-—cos }V1—uw2=—-r—cesc!—=.... 
u 
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5.4 TABLE OF INDEFINITE INTEGRALS 


5.4.1. ELEMENTARY FORMS 


3: [ou@)ae = [eu where y’ = 54 


4. Jo +v)dz= [ue + / vdz, where u and v are any functions of x. 


8. fudv=u f dv— fvdu=w-— [ vdu. 
6. fuGaaw- foZar, 


rth 
7. / xv” dx = except when n = —1. 

















n+l’ 
8. { S = loge 
x 
f(x) 
9. dx = log f(x), (df(x) = dx 
F(a) g f(x), (df(x) = f(x) dx) 
fe 
10. [ - te = VFB), (fle) = Fw) ar) 
2V f(x) 
a. fe dz =e". 
12. fe de = — 
a 
13 [wre = as b>0 
: — alogb’ 
14. Jroseae = nlogx — x, 
18, [ ade = 7 >0 
loga 
dx 1 4 2 
6. |, =-—tan i 
=tanh7! =, 
a 
ide a I= or 
a? — 
jp a? > aw. 
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1 aie 
—=coth ' =, 
dz a a 
. [ =" = or 
ee 1 La 3 2 
i pee >a’. 
4 
sin ial 
dx ui 
a*—ax =f 32 
— cos Tal’ a> x? 
a 














21 7 o deg sec! . 
‘| aVvze2—-a2 Ia a’ 
dx 1 a+ Va? + x2 
22. | ————. = — = log | ———— ]. 
ava? + x2 a x 


5.4.2 FORMS CONTAINING a + bx 





nz, (a+b 
23. | (a+ be) dz = (Mt lb” n#-—l. 
n = .\n+2 -_ a n+1 
24. [lat be) dz = Bin+2) (a+ bx) Pint) (a+bx)"™, 
n#-1, n#-2. 
2 ng. Iota (a+bx)"t? 2(a + bar)" 
2s. [ «%(a+ br) a= 7 = — 2a A+ +a na : 
n#-—l1, n#—-2, n#-3. 
26. pero bx)” dx = 
m+1 n 
ee i ie (a+ba)"—* da, 
mt+tn+1 mt+tn+1 
or 
cesT e™H(a + bo)" + (m-tn+2) f x(a ba)" de} 
or 
Ce — +H lena + br)? tt — ma f x(a + bx)” az] : 
dx 1 





[a + ba — alog(a+bz)], 


30 Lie eee eg 
foe an ae 





log (a + ba). 
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x il a 
af B tog (a+ 2) + a . 
x 1 —1 a 
2. f apap = 2 lope Ee 
n#1,n#2. 
33. / e dx = - (+ ba)” — 2a(a + bx) + a” log (a+ be)) : 


1 
4. | ———dxr = — 
: i (a + ba)? ibe: 











2 
a + ba — 2alog (a + bx) — = Ne 
a+ bx 








at+bar 2(a+ bx)? 
=1 i 2a 
(n — 3)(a+bx)"-3 © (n—2)(a + bx)”-? 
2 
a 


oso n#l,n#2,n#3. 


2 
log (a + ba) + 20 -s): 


iv) 
77) 
| 
r1T8 
om nN 
8 
ea 
w 
Q 
8 

| ll 
Sle 

St rN 





























dx 1 a+ ba 
7 Lig 
: lass a x 
dx 1 1 a+ br 
38.) ———— = ; 
late a(a+bx) a? oe 
. de «1: | 1 (2a+bar\” joo 2 bt 
“J} a(at+br)j3 a® |2\ atbe , 
dx 1 b a+ bx 
40. | ————~- = -— + — 1 . 
? lap a ae 
dx 2be-a BP a 
a. fa +bar)  2a2x? + aE eae 
dx a+ 2bxr 2b a+ bx 
42. | = i ; 
/=ct= alas ee a 

















c 
dx 1 c+2 2 5 
44 —, 
[= 2c soe = 
dx 1 rZ-C 
45. =— 2 2 
[== de ee a 























* {ater en eres tO-9 | eral: 
© | oman apo lesa @-9f ea]: 
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x 1 2 2 
80, f "5 de = Flog (e —c). 
x 1 
51. | ————— az = - ———_.. 
i (a2 — c2ynti “* In(a2 — 2)" 


5.4.4 FORMS CONTAINING a+ bz AND c+ dz 
u=a+be, v=c+dz, andk=ad—be. (Ifk =0, thenv = (c/a)u.) 


dx al v 
x la 

53. | —dxr=—(-l —-l 

3 [<= x - (+ og u og v) 
dx 1/1 4d v 

an 7 (G+ ghz) 











u bak 
38, [ “a =F + <a logy 
1 unr uw” 
———— | —— + D(n-m-2 — d 
k(n — 1) ca cae {= ae 
or 
m 1 u™ m—-1 
59 = 
/ dx =e — +mk f ax] ; 
or 


5.4.5 FORMS CONTAINING a + ba” 














60. [=m et ge nei, 
a+ bx? /ab a 
Egg a ee 
dx 2 —ab a— x\/—ab 
61. /—= => or 
a+ ba? — 
: tanh! = =u) ab <0. 
V/—ab a 
dx 1 _, ba 


x 1 2 
. | ——, dx = — log ba~). 
“3. [— c= > og (a + ba~) 
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x Gu a dx 
1.) — gee! 
. /— ane : [fo 
dx x 1 dx 
5. ——————— SS — a 
7 lieess3: 2a(a + bx?) = af 
dx 1 a+ ba 
6. | ——> = = | : 
° [oz ab? a — ba 
dx 
67. | ———-—_ = 
l= 
1 x a 2m—1 i dx 
2ma (a+ ba?)™ 2ma (a + ba?)™? 
or 
2m)! - -1 1 d 
(2m)! meee a if _ da 
(m!)? | 2a + (4a)™—r(2r)'"(a + ba?) (4a)™ J a+ ba? 
x dx 1 
68.2. |§$ ——————— = —-— 0. 
boa Simla baayn? A 
x? dx x 1 dx 
6 an a ge | 
Ie + ie 2mb(a + bx2)™ * sas | (a + ba?)™’ me 
or x 
] 
0. [ atta 2a 8 a+ ba? 
a / dr ai dx 
x(at+br?) ar ay atbsxr2 
1 in al dx 
2am(a+bax?2)™ af x(a+bar?2)™’ 
72. /— = or 
x (a+bx2)"7*" 1 uh at x2 
ee 
Qam+1 = r(a + ba?)" a+ ba? 
73. | dx _ - | dx -+/ dx 
. 2 (a + bx2)™*1 ~~ a x?(a+ba?)™ a (a+ ba?)rt1" 
dx kK] (k+2)9 _1 2a —k 
74. = —/-1 tan k= */F. 
[— 3a E °8 aabas + V3tan kVv3 | b 
a dx 1 J1 a+ba? _;, 2a—k ; 
75. == log 3 tan k= 3/2, 
[SS a (3 Sik+a re wae 
x? dx 
76. = =i ba? 
[3 3b eee 
dx 
77. = 
/— 
k 1. a?+2ka + 2k? 1 2ke 1/4 
Sige eg | ae ks (= ) 
2a E 2 wee eae? 1b 
or 
ke it at+k 12 a\1/4 
aes eta b a 
[plow SE + tan k |? ab<0, k= (-5) 


7s. | a ee ieee ee, k= /% 
J atbat  ~ 2k kK a 


x 1 x? —k 
79. | —*— dx = — log 2 —*, ab <0, k= =F. 
fae 7 tbe 8 eR 
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$0 / ze fe Li x? — 2kx + 2k? + tann? — Zee 
J a+ bat ~ abe [2 °° 2? Dke + 2k Dh? — a | ’ 
ab>0, k= (#)". 
x? dx 1 a—k 1 
81. | ——— = —— |log —— + 2tan ~ — b<0, k= 4/-4. 
[ae a [le St + = Z| - D 
x? dx 1 4 
dx 1 zl 
: = — log ——— ' 
= luc baz”) an Sot ban’ © ee 
84 dx _ -/ dx ~ | x” dz 
“J (atbar)™+1 a J (atbar)™ as (at bar)mtl" 
8s. / a” dx = | ei" da 2 / a" dz 
“J (atbaryett bf (atbar)je bf} (atbar)ett’ 
86 Z dx il da _ ob da 
J am(atbaer)ptt a J am(atbar)p af vm™—n(a+banr)ptl’ 


87. perat bx”)? dx = 





pe) [enna + bay" _ a(m —nt+ 1) pea + ba”)? as| 3 
or 
1 m+1 n\p m nyp-1 
|e (a+ ba")? + anp | x (a+ba")? ~~ dx} , 
or 
ot D [en + ba")?t! — btm +1+np+n) / at" (a+ ba”)? as| : 
or 
1 
aeED l-2" "(a +ba”")?t! 4 (m+1+np+n) / a” (a+ ba")?*! as] ; 


5.4.6 FORMS CONTAINING c? + 2° 










































































dx I (c£x)3 1 _1 2a Fe 
8 | oT - tyes (GS ta aa 
89 / da = x 2 i. dx 
“J (B+a3)2 9 33(8 +23) 33 J B+23 
dx 1 x dx 
90. — = 
| weet aa weep t 9 f weep 24 
a dx 1 CO+e2 1 _1 2a Fe 
a. | = er) = 5, 88 cay rr ria a/3 : 
92 / cdx x % 1 / x dx 
‘J (B+23)2  33(8+23) 33 J A+23 
x dx 1 x x dx 
93. = —_ 5 
| waspa— ne leeaetO-2f wrap] 24° 
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x? dx 1 7 2 
of = +5 log (c +x”) 
x dx 1 
95. : = : 
ie + g3)rtt 3n(c3 + g3)n’ n#0 
dx 1 Pia 
6. | a + 2) 303 3 = 
dx 1 3 
97. = 
| zetey* were teste 
98. = 
8 lz £23)"t1  3nc3(38 £23)" a/ze ayn’ n#0 
oo. | dx = 1 =| xdz 
| Pera ~ ata} era) 























100 / dx a! | dx _. Al | x dx 
x2(3 + g3)nti ~ 3 x2(c3 + g3)n T 63 (c3 + g3)nti 


5.4.7 FORMS CONTAINING c* + x4 
101. [ de _ [Sloe (See) 4+ tan7? ei. 














cA+at — 2¢3,/2 x? — ceV24 c? 2 — @? 
dx L fi c+2 12 
102. =~ |-1 t =|. 
la 2c3 5 eag. “| 


état 2c? (oa 


2 
103, f PR = sy tan ; 


























a dx 1 C427 
104, f= tog 55. 
2 2 rae 
10s, f a = . 5 og jo ca2 + ) +tan! en : 
C+a2 2e/2 | 2 x2 + caV/2+ ce c* — x 
2 
ra ee pd (eg a 
ct—z* %c)}2 c—2 Cc 
3 
xz dx = ah 4, 4 
107. f EE = + l0e(c a ie 
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5.4.8 FORMS CONTAINING a+ bz + cx? 


X=a+be+cx? and 


q = 4ac — b?. 


If¢g =0, then X =c (a + 5° and other formulae should be used. 














_1 2ca +6 





























— tan ; q> 0, 
va va 
d or 
108. /< = =? tanh7? 2cx +b eu 
v= va" | 
or 
1 2cxr + b— ./—q 
— log ——__—, <0. 
V-q ° 2cat+b+ V—-q ° 
dx 2ca+b 2c [dx 
109. / — = —/—. 
xX? qx qd xX 
dx 2cx +b 1 3c 6c? dx 
110. | — = —— (| — 4+ — nhac (peal 
Xt q (am r x) tel x 
Qcxa +b  2Qn—-A1jc f dx 
nqX” qn Xn’ 
dx or 
111. aa 
x a(S) sal S| q ) (*)+/ 
(n!)? \q q “~4\cx (2r)! 
a dx 1 b dx 
112. / — = —logX —-— |] =. 
xX 2c = 2c xX 
xdx ba+2a b f dz 
113. / —— =- a pf eS. 
of Saal S 
xdx Qa+br b(2n—1) [ dx 
114. =— _— ——_ |] — : 
Xt ngX” nq xn’ ee 
edz « b b? —2ac f[ dx 
116 a’dx  (b?—2ac)x+ab 2a f dx 
: xX? cq.X q xX’ 
m m—1 ay m—1 
uI7. x dx x 7 m+1b 7c ag 
Xn+1 (2n—m+1)cX"™ I2-—m+1icf Xr! 
si m-1 a 
2n—m+le 
dx 1 x? b dx 
us. | 2a oa) @ 
dx b xX 1 b? Cc dx 
119. = —> log = - — — - = 
; wx da? 832 ae t (= <) xX 
dx 1 b dx 1 dx 
120. = —-—f/—-+- 1. 
aX” Qa(n—1)X*™1 af Xa ‘) axe? "F 


dx 


¢ 


gm 2 


Xnrtl 





dx. 
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121 dv 1 pies 7 
“fo amXmtl —— (m—1)aa™-1X" ee es ee 


2n +m-— le dx 
m-1 a gm—2Kn+1 : 


5.4.9 FORMS CONTAINING Va + bx 
2. f Var bear = 2 Maro. 
123. [evarbed = Be 
124. [evarteds = 6a" — abe + 1S) Mat bap. 


TEE [e"VeT oP — ma f 2” Var Be de] 


(a + bx). 

















b(2m + 3) 
or 
a)" rt+l 
a> Fo art . 
laerE 
126. PO rare 
[> ne wae 
: gm > (m—1)a “pm =i 
128 / _de _ _ Watts 
| Vat ba b 
adx 2(2a — bx) 
129. | ———— = —- Va + br. 
Vat br 3b2 
x? de 2(8a? — 4aba + 3b?x?) 
30, [| i dt_ — 2(8a? = Aaba + 367x") | 
° Vat ba 1503 a+ bx 
2 ek 
eee 2™ a fe ae ae . 
i arm Pe a | 
igi, | 222 oF 
Jat br 2(-a ae ee = 
bm+l a as = nla . 
2 -1 fa+bez 
tan , a<0, 
132 / des ye —a 
SSF = or 
wVa+ ba i ( EE sa) _ 
a? \aweaeaal" : 





us fe = VEE 8 ft 
7 a2/a + ba ax 2a ane 
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dx = 
a/at bx 
Va + ba (2n — 3)b / dx 
gn 1 


~ (n—lyar"-1 — (Qn—2)a -l/a+ ba’ 
or 


feooe [red Sat Ca) Cu) fate 


2(a 4 ba) 2@tn)/2 


134. 











135. / (a + bx)*"/? dx = 














b(2 +n) 
tn) /2 (2+n)/2 
+n/2 (a + bax) a(a + bx) 
136. [ela +b) dt= 5 ee er eal | 








B7 / dx _ ~ | dx 7 - | dx 
“J a(atbar)’/2 as a(atbr)™-2/2 a J (a+bax)r/2" 


ae (n—2)/2 
138, [CE in [ (a+b)? dv a | A at 
x 


5.4.10 FORMS CONTAINING Va+ ba AND Vc+ dx 
u=a-+obz, v=c+dz, k = ad — be. 


If k = 0, then v = <u, and other formulae should be used. 





bd >0, k <0, 





; bd > 0, k > 0, 


da Lop out Voduv)? sq 
sf UD Vbd 8 Vv ’ ’ 
tan» ———_, bd < 0, 
1 : jo 
sin ~~ (ky ’ 

k+ — — k dx 
_ 8bd Juv 

1 ise dJu—vkd Vk 
Ve” bee a 

or 
2 

141, } — -) 1. (avu- ved) 
vV/u 7 — 


139. 








bd < 0. 


140. [Vien = 


kd > 0, 








—— tan” ——, 
V—kd V—kd 
zdx Juv ad+be dx 


142. — : 
\/uv bd 2bd \/uv 
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143. [= aco 
Vv kv 


Vv a UU k dx 
ag ee oR ae 


de 
145. [fea 2 a 
lol J uv 


m _ 1 m+1 uv” dz 








tet [arpa =~ maa (ater + (m— 5) *f aeetye) > m4 





a (onva- mx [ cin az) 
” b(2m + 1) Ju a 
148. [Re or 
Ju 2( 2 Vu hh mr (2r)! P 


caper Po Ge o) Ge 
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5.4.11 FORMS CONTAINING Vx? + a? 





v9. [ Ve Late = 5 [a x2 + a2 +a? log (e+ x £a?)]. 











150. 








= =lo (e+ xv? + a?) 
to pe 


dx 
151. | ——————. = — se 
/ tv x2 — a? ja| 


dx 
152. | —————= = 
laa a 
[page [2 Ge 
153, f OF ae = VP FoF - alog (ee*). 
x 


2 
a* =a ie 

154. | ————_ dx = \/x? — a? — |a|sec "=. 
a 


x 
155. — =, dx = x2 £a?. 


xe? + a? 


156. fev v+a?dz= 7 (a? £ a?)3. 
1 =, 3a°a 
157. | (a? +a?)3 dx = z(|* (a2 +a?)3+ x? + a? 
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2 2 
164, / dz = = o£ a? + Slog (w+ x? J 
av? + a? 2 
3 1 
165. dz = =\/(a? a?)3 = a? Vx? + a2 
ve =e a2 3 
ay) 
166. OP ee ee 





















































2 
170. fev (a? 0 a?) dz = ! (a? a a?)" - a (a? a= a?)>, 


eae 


oy) 
+ log (« + Var 
x 
































x3 Qa? 2a 
7D 742 1 
az? + a? _ V(x? + a?) 
174. i oa dz =F 30203 
2 
175 eae =— . + log (e+ x? J 
(¢ as a?)3 ve be a? 
3 2 
176 aes =Var?+a?+ = 
(a? + a?)8 a2 + a? 














178. | oe -_ = sec | 
aJ@aay aera? la] 
dx 1 x? +a? x 
19. | Sa al a * Vata 
180. 
dx - 1 3 
Piet: weep wet ee 
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181 de — : - é a, 3 sec7! = 
a3,/(a? —a2)3 = 2a?x?2/z?—a? 2atVaz2—a? 2 |a*| a 
m—2 
182 ca Logie oe OR - cE 
































Va? + a? 22™(m! m= 
+(+a")™ log (« + fart a®)| 
gett da “™ (2r)!(m!)? 
184 ae ee Aa?) 2? 














185 / dx _  Var£a® _ (m—2) dx 
: amy/x2 + a? . (m _ l)a 2qm-1 7 (m _ 1)a? wm-2./72 + a2 


= )! ! 2m—2r—-1 
186. | ——S__ = VE 2, tales 
2m 2 


wta (r!)2 (2m)!( a2)™ rp 2r+1 
r=0 


= ye er me ri(r = 1)! 


2r)!(4a2)m—" g2r 

















187. [ dx _ 2m 
“f gemti ly? a? aE 





(= en p22 +a 
+ 59m amt log a : 
dx _ (2m)! — a2 r\(r — 1)! 
188. / g2m+la/p? — gg? a (m!)? — Ee \!(4a2)™— T por 
+ 4 sec - 
Q2m |q/?2mrt a : 
Pa) 
189 i be eee ieee 
(a — a)V a? — a? a(x — a) 
Pe) 
190 7 = a 
(a + a) — a? a(a + a) 


5.4.12 FORMS CONTAINING Va? — 22 
in. [ J Par = 5 (x a2 — 22 +a? sin! =). 
2 |a| 


1 2 -—1 & 
= sin ia — COS 


dx 
py | — = oo 
lms ja| jal 


dx 

193, | a °8 
fade pe a: 

194, [ YO ae = Vor = — log (A =). 

x x 

x 
ly 
196. f e/a? =P de = -5 (a2 — x)3. 
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£ 1 
dx 
(a2 — x2)3 Ao pe 
xv (a? — «?)3 dx = —=\/ (a? — #?)5. 
2 x a’ 12 
x Va? — adr = a (a? a aa xv a? — x? +a° sin la 
a 
1 2 
aa? — x2 dx = i! ez (a? — x?)3 
2a 
[la 3d a 2)5 4 ; (a2 — x23 
4 6 
OO gage OO =) 
T36 a et ag la] 
a2 
/(a Bde = = a? — x2)" — —/(a? — #)5 
5 
2. qe gt a & git 
= 5 a we + sin ay 
dx - a? — x? 
x2 a* — x2 7 ax 
Vaz — x2 Va2 — x2 .-12 
———<— dx = —-———— — sin. —. 
oP x ja| 
Va? — x a? — x2 1 a+ Va? — x? 
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Xn/X (Qcx + b)(n!)(n — 1)14"k"-2 Rar)! 
q(2n)!\VX & (4kX)"(r!)? 
(Qca +b)V/X 1 da 
230. he Se ee ff 
3 [vv x Te + Oh ae 
_ (2cx + b)VX 3 3 dx 
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a—-Zz 

















dx 
21. / ———— = or 
/ V2ax — x? ee 
sin! ( ). 
|a| 
252. fev 2ax — x2 dx = 
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| oe na Var 


272. IV== aoa ft m= S sin ie 


5.4.16 FORMS INVOLVING TRIGONOMETRIC FUNCTIONS 


273. | sinaxdx = — o cos ax. 
a 


274. | cosaxdz = — * sin ax. 
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2a. | = = f cosec* axdxz = ae cot ax. 
sin? ax a 
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330. / ty = 
acos ca + bsin cx 
/ das = lacxz + blog (acos cx + bsin cx)| 
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(m—2r)! a2r+t (m — 2r—1)! 
r= 
1 xu, 
xcosaxdx = —cosax+ —sinaz. 
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= (2n + 1)(2n + 1)! 

COSAT n= 1)" (ax)?" 
1) oa 
= (2n)(2n)! 
2 
1 
xsin’ ar dx = i 7 sin 2ax — Baz cos 2ax. 


4 
x 
x’ sin’ ax dx = 


x 


xsin® ax dx = —— cos 3ax — 


12a 
2 


3 


6 


il 
36a? 





x? 1 . 
— {| — — —~ J sin 2axr — 
4a 8a 


J 


(—1)"m! 


(m —2r—1)! 


x 
=z cos 2an. 
4a 


x 


m—2r—1 


q27t+2 ig 


: 3x 30, 
sin 3axz — —— cosaxz + 7; sin aw. 
4a 4a 


x x 1 
x cos? axdz = — + —sin 2ax + Faz 008 2ae. 
a 


4 


r 
xcos’ axdx = ——sin3azx + 


12a 


4a 
8a3 


1 
36a? 


sin ax sin ax a 








cos BES, COS aX a 











+ COS AX 


[Vim cxar a = 


| ViFesarae = 


i 
- 
je 
/ 
| 3 a2 
c cos” ax da = =+ (= - 
ie 
| 
[> 
Ira 
I 
peer 
eer: 


& COS ax 





"a(1 + sin az) 


ax 
2 

x 

2 


x 
= rtan—. 
2 


2sin ax 
av 1—cosax 


2sin ax 


aV1+cosax = 











1 
=) sin 2ax + a cos 2az. 


32). 3 
cos 3ax + ie sinax + —= cosa. 


x 2 ax 
dx = — tan + -; logcos —. 
a a 2 











poe 24 . ax 
x = —— cot — + — logsin —. 
a a? 8 2 


4a? 


+ sinaz). 


396. 


397. 


398. 


399. 


400. 


401. 


402. 


403. 


404. 


405. 


406. 


407. 


408. 


409. 


410. 


5.4. TABLE OF INDEFINITE INTEGRALS 


For the following six integrals, each k represents an integer. 


/ 
/ 


2 (sin = —cos =), (8k —1)4 <a < (8k+3)%, 











V1l+sinaz dx = or 
—2 (sin 5 — cos =), (8k +3)5 <a < (8k+7)%. 
2 (sind +cos=), (8k —3)5 <a < (8k+1)5, 

V1l-—sinadz = or 
_ & x T T 
—2 (sin = + cos =), (8k +1)5 <a < (8k+5)%. 




















4 
x 
———— = or 
re —V2 log tan 5 (4k +2)0n <a < (4k 44)z. 
4 V2logtan (==), (4k —1)t <a < (4k 4+1)n, 
x 
— or 
V1l+cosz ie 
—v2logtan (==), (4k +1)t <a < (4k 4+3)z. 
; V2logtan (= — 7), 8k +1)2 <a@< (8k+5)z, 
x 
——_ = or 
VI—si 
— —V2log tan (5 - 2), 8k+5)5 <a < (8k49)5. 
; V2logtan(S +2), 8k —1)% <a < (8k4+3)%, 
xv 
Vl+sinz 
; —v2logtan (5 +2), 8k+3)% <2 <(8k+7)5. 








1 
tan” av dx = —tanaz — zx. 
a 
1 2 1 
tan® ax dz = — tan? ax + — log cos ax. 
2a a 


1 3 1 
tan‘ ax dr = — tan? ax — —tanar +2. 
3a a 


1 o = 
tan” ax dx = =D tan” ax — [ew ? ax dx. 
a(n — 


1 
cot? ax dx = —— cot ax — x. 
a 
1 1 
cot? ax dx = —— cot? ax — = log sin az. 
2a a 
if 1 
cot* ax dx = —— cot? ax + —cotar4+ 2. 
a 
os 1 n—-1 n—-2 
cot ax dx = —————— cot ax — [oot ax dx. 
a(n — 1) 


x cot ax 








1 
5 de = f wesc? axde = - + = logsin ax 
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411. / va [ eos" ax dx = — = 


sin” ax a(n — 1)sin”~! ax 


= 2 i: x de 
a2(n—1)(n—2)sin"-? a2 n—-1/ sin®-?axr ” 





412. / 7 dx = [ ese’ ax dx = — tanaz + = log cos ax. 
a a 


a3. / er cr = [ sec" ax dx = ry ee 


n — 1) cos"~! ax 





ab n—2 x d 
_—- 4+ Ss | se 
a?(n — 1)(n—2)cos”-2 ax n—1/J cos"-? ax 
sinax 1 . _; bcosax 


fb ————_- dz = — — sins ———.. 
V1+ 0? sin? ax ab Vv1+ 6? 


41s, | 28% ___ gy, = a log (0 cos az + V1 — b? sin? an). 
V1 —b? sin? ax ab 


2 
416. [isn ax)V 1+? sin? az dx = — Se a bi ei ah te sin~ beos ax 
a a 


414 











2 VI+ 2 
417. [isin ax)V1— 0b? sin? ax dx = — = or V1 — 8 sin? ax 
a 
=o bf lo (0 cos ax + V1 — b? sin? x) 
ab 8 ax+V in? az). 


1 
41g, | —S* _ gy = — log (6 sinaz + V1+4 6? sin? ar). 
V1+ 0? sin? ax ab 


oe — sin! (bsinaz). 


| ———_—_——— dr = 
V1 — b? sin? ax ab 
420. [0s ax)V1+ 6? sin? az dr = = V1 +02 sin? ax 
a 
+35 log (bsin ax + V1+ 62 sin? ar). 
a 


b 


421. [ios ax) V1 — b sin? ax dx = —“ V/1 — 0? sin? ax + ee (bsin ax). 
2a 2ab 


For the following integral, k represents an integer and a > |b| 


419 








422. —S—_ = 
Va-+ btan? cx 


1 ail a—b 3 
——— sin sincx }, 4k—-l)5 <a< (4k4+1)4, 
aaa (\ a ner) eet See 


—1 dsl a—b., 
= 3 4k+1)2 < (4k + 3)2. 
iae 4/ a snes) (4k +1)5 <a <( 3)3 


oS, 
Ly sin [(n — 2k 1 
423. [cos" xdxz = saat x (; a tg (:) x, nis an even integer. 


424. [cos" adxz = — (; 

















, mis an odd integer. 


5.4. TABLE OF INDEFINITE INTEGRALS 


ny 1 BN fn\sin([(n—24)(-2)]) 1 (n 


n is an even integer. 


NIs 





n—1 
s i — 2k)(4 - 
426. [se adr = sat » (;) salle og a) n is an odd integer. 


5.4.17 FORMS INVOLVING INVERSE TRIGONOMETRIC 


FUNCTIONS 
af] nee 
427. [sv avde = asin” ax + eo — : 
a 
Ifa ae 
428. [eos ax dx = xcos' ax — ——. 


429. fro ax dx = xtan~' ax — = log (1 +. a7”). 
430. [oot ax dx = «cot ax + = log (1 + a?x”). 
a 
431. [oot ax dx = «sec | ax — = log (ax + Vata? — 1). 


432. foot ax dx = «esc * ax + = log (ax + Varn? — 1). 





433. (sin! =) aes a2— 27, a>0. 
a a 
434. [ (cos =) dx = xcos7} = — a?— 2x7, a>0O. 
a a 
12 = -1% a 2 ) 
435. / (tan =) dz = xtan a 5 log (a + 2°). 
42 12 a 2, 2 
2 ie = aot | ae 
436 J (cot =) x = £CO 7 tg sla + 2°) 
437. [esi (ax) de = — (2072? - 1)sin7* (ax) +axV/1— aa”). 
a 


438. [cos (ax) dx = : (2072? —1)cos”' (ax) — axrV1— aa?) : 








4a? 
n+1 n+l 
439. ie sin” | (ax) dx = = 7 sin | (ax) — — — dz, n#-1. 
i grtt ‘ a rth 
[e's ae (a ee ar Vizaa n#-1. 





441. 


xtan”' (ax) dx = ———— tan”! (ax) — = 


442. | x” tan”! (ax) dx = ant tan” * (ax) — = ala dx 
n+1 n+1 1+ a?x? 





443. | xcot (ax) dx = ——— cot? (ax) + om 


333 


334 CHAPTER 5. ANALYSIS 





a = grth 4 a grth 
444. | x" cot (ax) dx = a cot (ax) + axl) tae dz. 
s 1 = _ AD. 2 —1 
us. | = ce, ae = alog (+ V1— aa ) _ sin (ax) 
x x x 
-1 JT = Geet 
446. | = ce dz = = cos | (az) + alog (4). 
x x x 
-1 2,2 
447. ee dx = -+ tan” | (aa) — 5 log (43). 
cot (ax) 1 4 a x? 
448. [ota = 7 too (ax) — 5 log ee 
/To alae 
449. [om (ax))” dx = «(sin (ax))? — 2a + wee sin! (aa). 
{T= que 
450. [too (ax))? dx = x(cos* (ax))? — 2x — va cos! (aa). 
a 
451. [on (ax))" dx = 


nv 1 — a*x2 


(-1)"n! = AZo r niv 1 — a2x? = naone 
me men ae eis > (—1) (Cop rene tan)", 


a 
or 
L$] — [a _— 
y. ies EL _ x(cos! ax)”~?" _ x, js =e (cos! an)", 
= (n — 2r)! = (n — 2r —1)!a 
sin bax es 2 
453. == d = 3a (sin ax) 


Ween n-1 n 


x” sin” ~ ax x . 1 x 
454. ——_ dx = =o V 1 — a?x? sin ax + 5 
V1 — a2x2 na na 





na? V1 —a?x? 
=a 

cos ax 1 4 2 
455. | ——————. dz = —- — (cos ax) . 

V1—a?x? 2a 

x” cost ax grt x” 

=i 
456. = It = ——Z V1 - a? 2? cos ax — —— 
1—a2x? na na 
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458. 


459. 





460. = = —_ | ————- 
n+1 ia n+1J Ja2xz2—T 


461. 


1 
462. | xcsc axrdx = = esc tar + —>v/a2x? — 1. 
2 2a? 


1 ng -1 


a” csc axdx = mae I CSC ax reigi Vaart 





463. 


464. 


5.4.18 LOGARITHMIC FORMS 
465. Jreoseae =axlogxz—a. 


2 2 
466. [vveede = = log 2 — =. 


3 3 
467. [ Pleseae = 5 loge - > 





grtt n+l 
468. | dx = l poh 
8 Je og x dx all og x (+i 


469. J (o8)* dx = (log x)” — 2a log x + 2a. 


x(log x)” — n/ (logx)""'dx, n#-l, 


470. / (log x)" dx = or 
i ee a n#é-l1. 





1 
(loge), nZ-1 


(logx)? (log) 
2-2! 3-3! 








dx 
472. fs = log (log x) + log a + 


dx 
473. 7 rice log (log x). 
dx 1 
a4. | aoa Cae Ott 


eg’ dx gmti ipa 1 a” dx 
Pe a : 
/ (logey” (1 —n)(logayy* "a —1 / (ogzyt "7 
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gimtt 
SL ferdogs) dx, 
mt+1 m+1 
476. [eGo x)" dx = or 
n n! m+1 - (— log x)" 
(-) m+i1- do atm +1)" 
gett 
477. ea cos (blog x) dx = ®rst [bsin (blog x) + (p + 1) cos (blog z)]. 
Pt 
478. fe sin (blog x) dx = @71Pse [(p + 1) sin (blog x) — bcos (blog x)]}. 
ax +b 





479. [ree (ax + b) da = log (az + b) — a. 


aso, [ PEED ae — ® tog x — Laas ee ey 





fim b bax 





m _ 1 sae b m+1 
481. Je log (ax + b) dx = a ( -) log (ax + b) 
1 b m+1 m+1 1 = 
m+1 a <r b 
" y m—-1 
aso, [ SEE ae = 1 log (ax +b) | 1 ee i ax +b 
x” m—-1 gmt m—1 b x 
m—2 r 
1 Gym 1 b 
sear ae See, oes 





= de = (« +a) log (w + a) ~ (« ~ a) log ( ~ a). 


m+1_ (_ m+1 
asa. / 2” log EAE gy = PC tog in ta) —* 


m+1 


== log (x — a) 


m+i1 


1 xv m—2r+2 

m+1 2, oe) , 
1 ata 1 r—a 1 x —a 

485. [ tog = ** ar = ~ tog ag oe 9 


For the following two integrals, X = a + ba + cx?. 




















486. [esx dz = 








b V — 6? 2 b 
(«+ =) eX oo tet ee b* — 4dac < 0 
2c c V4ac — b? 
or 
b 2 2 b 
(«+ me en ee b? — dac > 0. 
2 b? — 4ac 





46 _ b ge” A: 








488. [ree a” +a”) dx = «log (a +a”) — 2x + 2atan™ os 
a 

2 r+ a 

489. f tog (0! —a’)dx = xlog (x? —a ) — 2x + alog = =I 
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490. [eve (x? +a?) dx = ; (x? - a’) log (x? + a’) - st : 











491. Joes (« + Vfar2+ a?) dx = x log (« + Var2+ a?) —Va2+a?. 


x a rVxr?2 + a2 
24 42 = 4 2442) _ eran 
492. f clog (2+ x Ew) ae = (4 + ) tog (1 + x a) 7 ‘ 


m+1 
493. jae log (« + Va2+ a?) ée= = log (« + Va2+ a?) 
m+ 
































iL 
m+1 
a a diz 
m+1 av? + a? 
494 = Vx? +a?) _ log (x 4 Vx? +a ) 1 a+ Vax? + a2 
x? 7 x 
495. / log is ve a) dx = = (« Ve e) + ae : =, 
x? x la| a 
n 2 2 1 n+1 2 n+1 
496. | « log (« — a’) de = log (x* — a‘) log (x — a) 
L$] 2r naar | 


5.4.19 EXPONENTIAL FORMS 
497. fe dx =e”. 
498. pee dz = — 


499. [ ede = 5 
a 




















500. / ne" de = (ax — 1). 
xe = m m 1 an dx, 
a a 
son. f met da = se 
mia™—" 
et” So (-1)" ———: 
— part! 
= (m—r)la 
ax 2 3,3 
e ar arx 
ae dx = logx + toa a aaa 
ere a er” 
— za de 
= roasts fe By Hh 
504. Journ ee de. 
a a Z 





dx é e” 
508. [| = 2 —log(1 +e") = ss 
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dx x 


; 1 
506. | ——— = -- — 1 be?*). 
l= ap execu) 


a 


dx 1 —1 max a 
i aeme bem lab an (« Vi): a> 0, > 0 





oe (=). a>0, b>0, 


1 
2mvVab Vaem= + Vb 





dx 
508. —— 
08 / aemet — be maz or 
=e ( fe") a>0,b>0 
mv ab b , ; 
= a +a” 
509. 2 = ¢@*) d= 
0 iG a ) ze me 


ax 


e 


1 
510. | ———— dx = — log (b ey 
l= * ac etic") 


511. / ( 


515. / ee 


516. fe 
517. fe 
518. je 


519. 


e*” cos (bx) cos (cx) dx = 


ax ax 


xe é 


a 
1+ ax)? “ a?(1+ az) 


512. oe 
513. fe 


514. fe sin (bx) sin (cx) dx = 


2 iL. 2 
5 d ee: -—x“ . 
4 0 3° 


: _ e*” [asin (bx) — bcos (bx)| 
sin (ba) dx = —— a 
e** [(b — c) sin (b — c)a + acos (b — c)z] 
2 [a? + (b—c)?| 
_e** [(b+¢)sin (b+ c)x + acos(b + ¢)2] 
2[a? + (b+ c)?] 


ie ieltalir e** [asin (b — c)x — (b — c) cos (b— ¢)z] 








2 [a? + (b—c)?] 
PY e** [asin (b+ c)x — (b+) cos (b+ c)z] 
2[a? + (b+ c)?] : 
. . e** cose e** [acos 2b + c + 2bsin 2bx + c] 
sin (bx) sin (bx + Cc) dx = Da = —  2fa24+4e, 
: — e*sine  e** [asin 2br + c — 2bcos 2bx + c| 
sin (ba) cos (bx + c) dx = — 5a + a) 
cos (ba) dx = TE [a cos (ba) + bsin (bax)] . 


e** [(b — c) sin (b — c)a + acos (b — c)z] 
2 [a? + (b—c)?] 
e** ((b +c) sin(b+ c)x + acos (b+ c)z] 
2 [a2 + (b+ c)?| : 
e** cose _ e** [acos 2bx + c+ 2bsin 2bx + c] 








e“* cos (bx) cos (ba + c) dx = a Da? + a 
oF si “" asin 2b: — 2bcos 2b. 
e*” cos (bx) sin (bx + c) dv = —- {ee aes ares oe ore . 
ani. n 1 : ax. n-1 
e*” sin” (bx) dx = Pane [(asin (br) — nbcos (bx))e** sin” * (bx) 


+n(n — ye? few sin”? (ba) da| . 
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523. {* cos” (bx) d ee [(acos (bx) + nbsin (bx))e** cos” * (bx) 


+n(n—1)b? / e** cos”? (ba) as| . 





m x“. 1 m x . m— xz 
su. [x e€ sine dx = >a e€ (sine —cosz)— fr *e® sin x dx 


1 
Zo ™~"e” cosx da. 


525, / fo” sine dp pigeon he) 





a? + b? 
m m—1 ax : b b b d 
—pipi® @ (asin (bx) — bcos (bx)) da. 
m~ x 1 Mm Ls m m—-1 2: 
526. | x e coszdx = 5a e (sine +cosz)— 3 fc e sina dx 
—7 fate cosa dr. 
2 
527. pore wae ae oe + bsin (bx) 
a? + b? 
ue poe br) + bsin (br)) d 
paip/®* @ (acos (bx) + bsin (bx)) dx. 


528. | e*” cos” asin” «dx = 














e*” (cos™—' )(sin” x) [acos x + (m+n) sina] 
(m+n)? + a? 
Na ax = _ nan 
Ceres e**(cos™ 1 x)(sin”' x) dx 
m—I1)\(m+n az m— on 
er fe (cos™~? x)(sin” x) da, 
or 
e**(cos™ x)(sin”~* x) [asin x — (m+n) cos a] 
(m+n)? + a? 
ma ax m— + n— 
nee e**(cos™~* x)(sin” 1 x) dx 
(n — 1)(m+n) ax m + n—2 
ae are e°*(cos™ x)(sin” ~*~ x) da, 
or 
e** (cos x)(sin"~* x) [asin x cos xz + msin” x — ncos” 2] 
ie +n)? + a? 
m(m — 1 ae m— on 
ae 7 e**(cos™ ° x)(sin” x) dx 
= 1 
+ [et (eos x)(sin”? x) da, 
or 
e**(cos™—! x)(sin”~' x) [asin x cos x + msin? x — ncos? x] 


( 
po et) 5 [et (cos" ax)(sin”~? x) da 
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ax 




















529. je sin (bx) dz = a 7) [asin (bx) — bcos (ba)] 
eo" : 
“jae [(a? — 6?) sin ba — 2abcos (bx)] . 
530. pee cos (ba) dx = se [a cos (bx) + bsin (bz)] 
et? . 
j@ ib? [(@? = b?) cos ba + 2absin (bx)] . 
ax ax . 2 2 ax 
sat. / ae ee eee ee 4 & +in=2) / eae Soe 
sin” x (n —1)(n — 2) sin"~* & (n—1)(n—2) J sin"? x 
ax ax 7 oe _ a 2 - 2 ax 
532. / ot due [acosz—(n—2)sinz] | ai +(n—2) 7 e€ ae. 
cos” x (n — 1)(n — 2) cos™-ta (n—1)(n — 2) J cos™-?.x 
n—-1 
533. fe tan” «dx = ae arene ee tan”! «dx — / e** tan” * x dz. 
n—-1 n—-1 


5.4.20 HYPERBOLIC FORMS 


534. [sine dx = cosh x. 

535. [cosns dx = sinha. 

536. [tantedr = log cosh z. 
537. [cothede = log sinh z. 
538. j[sechvas = tan”! (sinh). 


539. [ocschnds = log tanh (=). 





540. / x sinh «dz = xcosha — sinha. 

541. fe sinh x dz = x” cosh x — nf x” ' (cosh x) dx. 
542. : x cosh x dx = x sinha — coshz. 

543. / x” cosha dx = x” sinh x — nf x” ~' (sinh x) de. 
544. / sech x tanh « dx = — sech a. 

545. / esch x coth « dx = — csch a. 

546. / sinh’ ede = S0b22 _ > 
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547. [sin xz cosh” «dx = 

















: = n-1 : = 
sinh"™*+ x cosh” + & + sinh™ xcosh” * adz, m+n#0, 
mtn mtn 
or 
al . 1 m-1 : -~2 
sinh”! a cosh"*! x — sinh” “acosh"xdz, m+n#0. 
mtn mtn 








dx 
= iu (sinh” x)(cosh” x) 




















z 1 ae dx ces 
(m— 1)(sinh™~! «)(cosh"~1 x) m—1 (sinh™~? x)(cosh” x) , 
or 
1 m+n—2 dx 
+ — | —__________ dz, 1; 
(n — 1)(sinh™~* 2)(cosh”~* x) n—-1 | aoe x) (cosh? a) . ne 
549. [ivant? zdx =x — tanh. 
n—-1 
550. [iant” xdxz = an + / (tanh”? x) dx, n#1. 
551. [sect? xdx = tanh. 
552. [cost dx = ae + a 
4 2 
553. [coth? xdx =x —cotha. 
thet 
554. [cotn” xdx = + [coth"* rae, n#1. 
555. [ocset? xdx = —cothz. 
556. [ocint max)(sinh nz) dx = ee an eae m #n?. 
2(m +n) 2(m —n) 
: L en ce 
557. J (cosh max)(cosh nx) dx = Sea + ee m £n?. 
558. [inn mx)(cosh nx) dx = Cen UE oes m £n?. 
2(m +n) 2(m — n) 
559. ; (sinh *) dx = xsinh~! = — V«z2+a?, a>0. 
a a 
1x x a 1c 2 
560. [oe (snk “) dx = | — + — } sinh — —--\V/2?+a?, a>0. 
a 2 4 a 4 
; n+1 rl 1 grtt 
S61. / 2” sinh” = 7 oa View n#—1 
, zcosh~' = — \/z2—a?, cosh '2>0, 
562. / cosh! = da = or 
a lz 


zcosh | = + V/z2—a?, cosh 2<0,a>0. 
a 
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2 2 
363. | « (cosh - )d = ($-F) cost tee xz? — a? 
564. | x” cosh” «dx = ite cosh! x — : aa n#-1 
+1 n+1) Je? =1 ? 
365. / (tanh! “) dx = atanh~! = + © tog (a? — 2”), |=| <1 
a a 2 
366. | (coth™ =) dx = xcoth-! = + = log (a” — a”), [Z| >i. 
a a 2 & 
4. @ x? — a? 120. az 
567. x (tanh =) dx = tanh ~—+ —, |=| <i, 
a 2 a 2 e 
- _ n+1 i 1 grtt 
568. [| «tanh «dz = tanh ~ # — dz, n#-1 
n+1 1-— 
569. [x (coth '=) dx =~ 7 oth 7+ =, |2| > 
n+1 n+1 
870. [ 2” coth"! ede = 7 coth + —/a5 * 7 @ n#é-—l. 
571. [scar 'edx =xsech 'x+sin ' 2. 
2 
1 
572. [sect adz = + sech* a — gV1- 2. 
n+l1 1 n 
573. ie sech™' a dx = Tyee tet os f Ede, n#-—1. 
574. [ose ‘dz = wesch"! x + sinh” 
x 
2 
I 
375. [ wesch™! nde = > esch™ a+ aaVit® 
n+1 1 ¢« a” 
576. "esch-adr = — och et} [fg , —1. 
[e n+l ntl Viger” "* 


5.4.21 BESSEL FUNCTIONS 
Z»(a) represents any of the Bessel functions {J,(x), Yp(a), e?™*K,(x), Ip(x)}. 
577. ferrzce) da = x? *" Zy41(2). 
578. [ae des =n P's (a). 
2 a 
579, / x [Zp(ax))” de = > [[Zp(azx)]? — Zp-1(ax)Zp+1(az)] . 
580. [ac) dz = —Zo(x). 


581. [ 20a) dx = @Z;(x). 
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582. 


583. 


584. 


585. 


586. 


587. 


588. 


589. 


590. 


591. 


592. 


593. 


594. 


595. 


596. 


597. 


598. 


om SO SOS ES 


SS ON SO RS 


AS oye SS SoS 


o 


— 


7: 8 8 8 


B 


8 


8 


8 


8 


xz —a)™(b—2)" dz = (b—a) 
d 1 
oe ey ed, 
em m—-1 
d 
aeajr = TPT, O<p<l. 
dx 
ae ee O<p<l. 
@P 
Gane oom: |p| <1. 
xP i= (1-2)? 
(—ajpH  ~ J, ger 
p-1 
se = ii ; U<p< 1. 
l+z2z sin pt 
m-1 
zs dx = “7 0<m<n. 
l+a” nsin = 
Pao m(eti—be)/b ne 
ar dt ——— 
(m+ 2x?) 
dx 
=. 
(l+a)/z 
1 
| > 0, 
5 a 
4 r 
7 5 dx = 0, a=0, 
a" + @ or 
=e a<0. 




















T(m +n +2) 


m>-—l,n>-l, b>a. 


\T(e- 


T(c) 


a>-1,b>0,m>0,c>. 


nl! 
(n+ 1)! 


a> 0, nis an odd integer. 


a” 'e-“dzx=T(n), Ren>0. 
ap * dx = Wospy p > 0, nis a non-negative integer. 
iz ; T 
gr te (ate ga = n>0,a>-l. 
(a+1)” 
1 n 
in if T'(n+ 1) 
x (10s +) OO a ee m>-l, n>-l. 
co m—-1 
m—1 n—1 x T'(m) P(n) 
1-— dx = = 2 
x (1-2) xc | Giayer Toman): n>0, m>0 


m+ntil(m+ 1) P(n +1) 


? 


dx = —nmcosecpr, —1<p<0. 


T ntl 


a ’ 
2 
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a 7 1 
599. [ a (a” — 2?) /2 dx = ge eee a> 0, m> —l, n> =—2. 
2 
600. ; i 
7. _ 
“?) n+2\? n> —l, 
2 T(*) 
m/2 n/2 or ‘ 
/ sin” «dx = / cos" «dx = (n— 1)! a n £0, nisaneven integer, 
: 0 ni 2 
or 
,— 1)! 
m nl! ’ n #1, nis an odd integer. 
T 
2” a> 0, 
sin ax or 
601. / dz = 0, a= 0, 
: or 
7 
<p 0 
2? a< 


602. | et dp, 

0 i 

603. | a 
0 x 2 


ova. | ee 2, Oe, 
0 & 2 





605. / sin (nx) sin (mx) dx = / cos (nx) cos (max) dx = 0, 
0 0 
n#m, nis an integer, m is an integer. 


n/n wT 
606. / sin (nx) cos (nx) dz = 7 sin (nx) cos (nx) dx = 0, nis an integer. 
) 0 


2 
© a a — bis an odd integer. 
oor. | sin ax cos ba dx = . ar 
0 
0, a — bis an even integer. 
0, ja| > 1, 
or 
608. pee w= =, lal =1, 
” ? or 
T 
ms dl, 
mal < 
= O<asd, 
609. i sin an ba: i ai 
x 
° = 0<b<a. 


wv us 
F T ; é 
610. / sin? ma dx = : cos” ma dz = 5° m is an integer. 
0 0 


CO: 7.2 
611. / ae de = adil 
0 x 2 


612. 


613. 


614. 


615. 


616. 


617. 


618. 


619. 


620. 


621. 


622. 


623. 


624. 


625. 


626. 


627. 


628. 


629. 


630. 


I 
I 
l, 
I 
' 
i‘ 
I 
i‘ 
I 
I, 
a 
I, 
I 
I 
i: 
I 
is 
I 
I 
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sin x T 



































dz = ———————_., 0 < p<. 
mo 21(p) sin (pr /2)’ . 
COS & T 
dx = ————_., 0 < p<. 
a“ ~ B0(pycos(pm/2y 
1 — cos px T |p| 
= da = —- 2 
0 q>p>0, 
or 
SE ee. Pat 
o or 
T 
ae = 0. 
7? p=q> 
cos Mx — 7 -|ma| 
x? +a? ~ 2Ial 
fe 2 1 [a 
cos x? dx = sina’ dx = ~=4/—. 
5 2V 2 
sin (ax”) dx = : r : si n>1 
n ~~ nal/n n n5 : 
1 1 us 
cos (ax” )de= 1 (+) C08 5 n> 
sin x cos x T 
dr = dx = ,/— 
= [ ve V2 
3 
sin” x us 
dx = —. 
iam | 
ae 
sin? x 3 
= d = 7 log 
sin’ | — 3 
x3 8 
4 
sin’ x T 
a _ 
1 
cos 
es 1 
Tacms si JI — a2’ - 
T 
eee eee b>0. 
— de az — b2” ete 
a = ge, jal <1 
a. 1—a? 
eee = oe |” b} 
a 
dx T 
dz = ——. 
a2 sin? x + b2 cos? x 2 |ab| 
F 2 b2 
a pO), gsc heh 


(a? sin? x + b? cos? x)? 4a3b3 
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n/2 1 
631. / sin” ‘ xcos™ ‘adr = 5B(= *), 


mis a positive integer, n is a positive integer. 


n/2 Qn)! 
632. / sin?” adr = ier n is a positive integer. 
0 n M" 


a 2n — 1)! 
633. i: sin?” «dx = Sas n is a positive integer. 


T/2 1 21. 1 1 
4. dz =2(—=-2+—2-H4...). 
- [ sing (3 3? a De of? 7 ) 


n/2 
635. i a= dz = 2 mis real. 
0 4 





1+tan™ x 
n/2 (2)3/? 
636. cos x dx = ———,.. 
0 ((1/4))° 
n/2 ; 7 
637. | tan’ «dx = ——~_x, 0<h<l. 
0 2cos (4) 


a /2 -1 _ -1 
638. | ta ee fie. 4 
0 x 2 b 


63. | a a> 0. 
0 


co jan bx 
640, | Se eee oe 
0 Hb a 





Mn ame a>0, n>-1, 
co qrt 
641. di wre "dx = or 
0 n! 
Gn? a> 0, nis a positive integer. 
6a. | ee fp oe OP). 9G pene i: 
0 pai?+1)/p 
643. ‘| of ee asl, 
0 2a 
baw? 1 /ax 
64a. | e “" dx = =4/—erf (bVa), a>0. 
0 2Va 
es 1 [re 
645. / edz = —,/ erfe (ba), a> 0. 
b 2Va 
646. / Oe ae 
‘ 2 
647. / ate? dx = vn 
: 4 
oe) _— '! 
648. i a8 da = eases, (2, a>0,n>0. 
5 2(2a)” a 
649. / girtle-ar? ge 7 a>0,n>-1. 
0 
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* m= —axr m! —a = a” 
650. | e dz = el l-e De : 
co —2\a 
ost. | e(-27-08/0") gg = © 
0 





“cos ma dx = eet a> 0. 
+m? 
es acosc — bsinc 
‘cos (ba + c) dx = gee a>0O. 


2 m 
“ sin ma dx = eam % > 0. 
m 
bcosc+asinc 
a + be ’ 


en-™ * ihe se a>0. 
G2 


* sin (ba + c) dx = a> 0. 





et 


a= 
‘cos ba dx = —————~, a> 0. 
at‘ + 


l 
Le 
i 
a 
:< 
.- 
o 
< 
oot. | Fr ml ci a2 | 
< 
a 
se 
_ 
i 
4s 
ie 
7 
is 





é€ 





n! [(a — ib)?** + 
2(a? te b2)n+1 2 


—ax 


cos ba dx = a>0,n>-1. 


“sin x = 
———" dx = cot ‘a, a>0. 


a? x? 


ve exp? /(42") ab > 0. 


cos ba dx = 2a] ; 


e 70%"! sin (x sing) dx =1(b) sin (bd), b> 0, -$<o< F. 
e 7°87"! cos (x sin ¢) dx =T'(b) cos (bd), b > 0, -$<@< F. 
= br 
' cos a dx = I'(b) cos >a) 0<b<1. 
= . [br 
' sin a dx = T(b) sin 3} 0<b<1. 
(log x)" dx = (—1)"n!, n>-1. 


670. 


a 
is 
~ 

| : 
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1 1 nm 
671. / (10% *) dx = nl. 
0 x 


3 


1 
672. i x log (1 — x) dx = —-. 
0 4 


1 
673. / x log (1+ 2) dz = 
0 


ALE 


(-1)"T(n + 1) 


1 
674. i x (log x)" dx = m > —1, nis a non-negative integer. 
0 








(m+ 1)m+1 ? 
1 5 2 
ors. | WEF gp. 
59 1+” 12 
2 
of 222 ee 
0 —f£ 6 
“: 2 
677 / log(L+2) a, 
0 x 12 
1 = 2 
or. | log(l~2) 2 ™ 
0 x 6 


2 


1 
679. / (log x) log (1+ 2) dx = 2 — 2log 2 — = 
0 

















1 2 
oso. | (log x) log (1 — 2) dx =2~ =. 
0 
log x ne 
1. =—-—. 
68 [ [- dx 3 
lta\dx 7° 
2. log —=—. 
ee [ on (7+) x 4 
log x T 
: —— dr = - = : 
683 er x 7 log 2 
ve 1)" — T(n+)) 
1 oP — 2 pt+l 
5 dx =1 — - =i 
68 any: xz og (244). p>-l,q>-1 
686 a en 
9 V—loga | , 





n/2 m/2 
688. - log sina dx = i log cos x dx = = log 2. 
0 0 
n/2 7/2 T 
689. / log sec x dz = / log cosec x dx = 3 log 2. 
0 0 
T ar? 
690. i x log sina dz = S log 2. 
0 


n/2 
691. / (sin x) log sin x dx = log 2 — 1. 
0 
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n/2 
692. / log tan x dx = 0. 
0 





a> b. 


Tw a/q2 — h2 
693. / log (a t bcos x) dx = 7 log (oo). 

) 

oe Qrloga, a>b>0, 
694. 7 log (a? — 2abcos x + b?) dx = or 

0 2Qrlogb, b>a>0. 





695. / ie ih 
(0) 


sinh bx 2b 2 |b] 
°° cos ax T an 
96. ——_ dx = — sech —. 
/ coshba 2b 2b 


on. | eT, 
9 coshaz 2{al 


co r 1 
3 dx = —~ > 0. 
vs i, sinhax  4a2’? = ° 





























ie a 

ooo. | e cosh (bx) de = >, |bll<a 
700. | e** sinh (br) dx = >—G, |bll<a 

°° sinh ax T aw 1 
701. ——_ dx = — csc — —- —, D> 0. 

[ ee Ope gt 
702. | ee pS a b>0. 

9 ef =1 2a 2b b 
703. : ; A 
n/2 dx T 1 2 1-3 4 1-3-5 6 

ee eee ee ee k 
0 1—k?sin?x 2 +(5) +(F5) +5 4 :) °F , 

Re<1. 

nee dx © Peal. lee | gach 

vo. | (1 — k? sin? w)3/2 2 +(5) on +(5 +) a 
LOY % : 
(8) Th s..\ SAy 

n/2 2 . 2 14 
70s. | Viewers ia (2) Pal 22) = 

: 2 2 x 3 

2 16 
1-3-5\7k : 


706. | e  logadx = —4. 
0 


ror. | e* logan de = YE (7 + 21082). 
0 
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5.5.1 SPECIAL FUNCTIONS DEFINED BY INTEGRALS 


Not all integrals of elementary functions (sines, cosines, rational functions, and oth- 
ers) can be evaluated in terms of elementary functions. For example, the integral 
f e-* da is represented by the special function “erf(a)” (see page 475). 

The dilogarithm function is defined by Lig(z) = -f In(1 — t)/t dt (see 
page 488). All integrals of the form [” P(x, VR) log Q(x, VR) dx, where P and 
Q are rational functions and R = A + Bx + Cx?, can be evaluated in terms of 
elementary functions and dilogarithms. 

All integrals of the form {), R(a, \/T(«)) da, where R is a rational function of 
its arguments and T(x) is a third or fourth order polynomial, can be integrated in 
terms of elementary functions and elliptic functions (see page 470). 





5.6 ORDINARY DIFFERENTIAL EQUATIONS 


5.6.1 LINEAR DIFFERENTIAL EQUATIONS 


A linear differential equation is one that can be written in the form 

bn(x)y™ + ba—i(a)y-) +--+ + b1(x)y! + bo(x)y = R(x) (5.6.1) 
or p(D)y = R(x), where D is the differentiation operator (Dy = dy/dx), p(D) is 
a polynomial in D with coefficients {b;} depending on x, and R(x) is an arbitrary 
function. In this notation, a power of D denotes repeated differentiation, that is, 
D"y = d"y/dx”. For such an equation, the general solution has the form 

y(x) = yn(x) + yp(z) (5.6.2) 

where y;,(x) is a homogeneous solution and y,(x) is the particular solution. These 
functions satisfy p(D)y;, = 0 and p(D)yp = R(z). 


5.6.1.1 Vector representation 


d 
Equation (5.6.1) can be written in the form = = A(x)y + r(x) where 
x 


y 0 1 0 ... 0 0 
y' 0 0 1 0 0 
1 F 

y= , A(z) = , r(x) = 
0 0 0 1 0 
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5.6.1.2 Second order linear constant coefficient equation 


Consider ay” + by’ + cy = 0, where a, b, and c are real constants. Let m1 and m2 
be the roots of am? + bm +c = 0. There are three forms of the solution: 


1. If m, and mzg are real and distinct, then y(a) = cye™!” + cge”2” 

2. If m, and mz are real and equal, then y(a) = cye”"?* + cgae™” 

3. If my = p+ ig and m2 = p — ig (with p = —b/2a and q = V4ac — b?/2a), 
then y(a) = e?” (cy cos qx + co sin gx) 


Consider ay” + by’ + cy = R(x), where a, b, and c are real constants. Let m 
and mz be as above. 


1. If m, and mg are real and distinct, then y(x) = Cye™* + Cge™” + 
e™® /(my — mg) [” e~™* R(z) dz + e™*/(m2 — m1) [” e~™* R(z) dz. 
2. If m1 and mg are real and equal, then y(a) = Cye™!* + Cove™*” + 





gem f* e—™2 R(z) dz — e™* [* ze-™ 1 R(z) dz. 
3. Ifm, = p+igand m2 = p — iq, then y(x) = e?* (ci cos gx + co sin gx) + 
eP® sin qu/q [” e~P* R(z) cosqz dz — eP® cosqau/q f* e~?* R(z) sin gz dz. 


5.6.1.3 Homogeneous solutions 


For the special case of a linear differential equation with constant coefficients (i.e., 
the {b;} in Equation (5.6.1) are constants), the procedure for finding the homoge- 
neous solution is as follows: 


1. Factor the polynomial p(D) into real and complex linear factors, just as if D 
were a variable instead of an operator. 

2. For each non-repeated linear factor of the form (D — a), where a is real, write 
a term of the form ce“”, where c is an arbitrary constant. 

3. For each repeated real linear factor of the form (D — a)", write the following 
sum of m terms 


ee?” + cane egn*e << +o, 16 (5.6.3) 
where the c;’s are arbitrary constants. 


4. For each non-repeated complex conjugate pair of factors of the form 
(D —a+ib)(D — a — ib), write the following two terms 


cie*” cos bx + ce" sin ba. (5.6.4) 


5. For each repeated complex conjugate pair of factors of the form 
(D —a+ib)™(D — a -— ib)™, write the following 2m terms 





c,e*” cos bx + cge” sin bx + c3xe cos bx + cave sinbr+... 
m-lear sin ba. (5.6.5) 


6. The sum of all the terms thus written is the homogeneous solution. 


+ Com—1u™™ be cos ba + Cam 
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EXAMPLE Por the linear equation 











y — 14y© + 81y® — 252y + 455y — a74y” + 263y’ — 60y = 0, 





p(D) factors as p(D) = (D — 1)?(D — (2 +4))(D — (2 —i))(D —3)(D — 4). The 
roots are thus {1, 1, 1,2 + 7,2 — i,3,4}. Hence, the homogeneous solution has the 
form 


yn(x) = (co toaat co”) e* + (c3sinz + ca cos 2) 62” + cse?* + cge** 


where {co,... , ce} are arbitrary constants. 


5.6.1.4 Particular solutions 


The following are solutions for some specific ordinary differential equations. These 
assume that P(a) is a polynomial of degree n and {a, b, p,q, r,s} are constants. If 
you wish to replace “sin” with “cos” in R(x), then use the given result but replace 
“sin” by “cos,” and replace “cos” by “— sin.” 


1. Particular solutions to y’ — ay = R(x) 
(a) If R(x) = y =e" /(r —a) 
(b) R(a) = sin sa, 
y= Pe aceite = i — Se (a? + ey sin (se +tan-* =) 
a? +s a 
(c) R(x) = P(a), 











/ i n 
pe poy) Pee +7 
a a a 
(d) R(x) = e"™ sin sa, 
Replace a by (a — r) in formula (1b) and multiply solution by e”* 
(e) R(x) = P(a)e™, 
Replace a by (a — r) in formula (1c) and multiply solution by e”* 


(f) R(v) = P(x) sin sz, 


q™ 


a2 


y =—sin sx [aa P(o) + So 
oe i (jet ee a a2 pV (g) +. 
— cos se|— aP (2) + aay) 
er (ere a PP pane +...]; 


(g) R(a) = P(x)e"™ sinsa, 
Replace a by (a — r) in formula (1f) and multiply solution by e”* 
(h) If R(x) = e®, y = xe 
(i) If R(w) = e**sinsa, y= —e% cos sa/s 
GO tka Fiaje™, yee) Pie\ae 
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e*” cos sz P"(2) P“4) (a) 
2. Particular solutions to y” — 2ay’ + ay = R(a) 


(a) If R(v) =e”, y=e"/(r—a). 
(b) If R(x) = sin sa, 





_ (a? — s*)sinsa+2ascosst 1 ee eee 2as 
a= (a? + s?)? a? + 82 a? —s 
(c) R(x) = P(a), 5 
1 2P' (x 3P" +1)P 
y= 3 [P+ FE, Sr 
a a a a 


(d) R(x) = e"™ sin sa, 

Replace a by (a — r) in formula (2a) and multiply solution by e”” 
(e) R(x) = P(a)e™, 

Replace a by (a — r) in formula (2b) and multiply solution by e”” 
(f) If R(x) = P(x) sin sa, 





. a? — s? a? — 3as? _, 
y =sin sx | Cay PCa) + 2 ays P (x) 
ak — (B)ah-25? + (Mak-454 — er 
eee, GEES. vt pl (a) +...| 
2as 3a?s — 83 : 
+ cos sx 7 ra gan Gar (x) 
. +@—-yWets-@e gk-363 4 |. ~PO)(z) +...| 


(a? + s2)* 
(g) R(a) = P(x)e"™ sin sa, 
cat a (a — r) in formula (2f) and multiply solution by e”” 





(h) If R(x) = c= oe 
(i) If R(w) =e" sinsa, y= —e*” sin sa/s” 
(j) If R(x) = P(aje"", y=e" f pr P(z) dz dy 
(k) R(x) = P(x)e* sin sa, 
" (4) 
y=- [Pte) - ve ) ee, 


2 





ore oP 4p" 6P&) 
e | (x) 2 ee... 


s 8 33 3° 


). 
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3. Particular solutions to y” + qy = R(x) 


(a) If R(x) = y =e" /(r? +4) 
(b) ree = ie SL, y = sinsa/(q —s”) 
(c) R(w) = P(x), 
pe [p@) - FO, 7 4p Le) 
q q va qr 


sin sx, 


(d) If R(x) =e" 





e* . —1 2rs 
VWGtas tai Greye sin [se — tan >a aa 
(e) R(x) = P(a)e™, 
e"” 2r 3r? — 
= P(x P'(x +o 
y lk (x) qtr? (x) (q+r2)? 


k 


feet pq GE ig as 





$94 (=1) (q — s?)2* 
_ 8 COS Sx 2P'(x) _ As? + 4q om = 
q-# a 82) (q—-s2)3 (x) 


+-+»+(-1) (q = 82) 


4. Particular solutions to y” + b?y = R(x) 


(a) If R(x) = sin bz, y = —x cos ba/2b 


(b) If R(x) = P(z)sinba, y = Oye [P (x) — oye 
a 45 P'(a) 
f [P@)- ae t+--| ae 


5. Particular solutions to + py’ + qy = R(z) 


(a) If R(x) = y=e"*/(r? + pr +a) 
: (q—s”) sin sa—ps cos sx 

(b) If R(x) = sin sz, Y= ~—(q—s2)?+(psy2 
(c) If R(x) = P(z), 

1 Po P — don 

=[P(a) -2P@) («) 

n n—-1),n-2 n—2\, n—4_2 
_ + _ 

peg ype mae 

(d) R(x) = e"* sin sa, 


_ (r?—s?+q)e™ sin sx—2rse™™ _ 
y= (r?—s2-+q)2+(2rs)2 > 


CHA + CHM). 


k+1 (7") eae ae eae 


sin(se—tan 


COS Sv 


POD (gz) + 


PRM (x) 4. 7 


PRAD (g) 4 ] 


pl ey ale 
ear 


—1_ps 
q—s2 


— o/(a=s?)?-+(ps)? 


2 
DY” — 2pd wn 
—— F(z) 


pl) (p) 


In (5b): replace p by (p + 2r), q by (¢+ pr +77), multiply by e"® 
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(e) R(#) = P(ax)e", 
In (5c): replace p by (p + 2r), q by (¢+ pr +7), multiply by e"” 


6. Particular solutions to (D — a)"y = R(x) 
(a) If R(x) =e”, y=e'/(r—a)” 
(b) If R(e) =sinse, y= PL [(a" = (f)a"?s? + 
(f)a"—4s4 — a gee ‘arts + (Z)a” 353 +.. .) cos sc 
(c) If R(x) = P(e ), = 


See ee 


(d) R(x) = e" sin sz, 

Replace a by (a — r) in formula (6b) and multiply solution by e"” 
(e) R(a) = P(ax)e", 

Replace a by (a — r) in formula (6c) and multiply solution by e”” 


5.6.1.5 Damping: none, under, over, and critical 


Consider the linear ordinary differential equation x” + pa’ + 2 = 0. If the damping 
coefficient js is positive, then all solutions decay to x = 0. If js = 0, the system is 
undamped and the solution oscillates without decaying. The value of jz such that the 
roots of the characteristic equation \? + A + 1 = O are real and equal is the critical 
damping coefficient. If ~ is less than (greater than) the critical damping coefficient, 
then the system is under (over) damped. 

Consider four cases with the same initial values: y(0) = 1 and y’(0) = 0. 


lL. y”+y=0 Undamped 

2. y” +0.2y’+y =0 Underdamped 

3. y+ 3y'+y=0 Overdamped 

4, y"+2y’+y=0 Critically damped 


























~0.4 \ 4 
‘ / 
‘ / 
-~0.6 ‘ / 4 
\ 4 F 
7 —-—- no damping 
-~0.8+ * Wy under | 
. 2 over 
Meg 7 = — = critical 
I 
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5.6.2 SOLUTION TECHNIQUES 


Autonomous equation Change dependent variable to 
fly, yor", = ne y", y’, y) = 0 u(y) = y' (x) 
Bernoulli’s equation Change dependent variable to 
yi + f(a)y = g(a)y” v(x) = (y())*™ 
: 7 : 
oa, One solution is f(aC — y) = g(C) 


Constant coefficient equation ; 
There are solutions of the form 


(n) (n—1) 
a i y = xe”, See Section 5.6.1.3. 





Tr ini + any = 0 


Dependent variable missing Change dependent variable to 
fy, y™, yy’, 2) =0 | ule) = 9/(2) 
Euler’s equation 


n,(n) | 


apa" y™ + aya" ty"—Y +... | Change independent variable to x = e* 





+ dn—1ry + any = 0 
Integrate M(x, y) with respect to x 


Exact i 
macys uae holding y constant, call this m/(z, y). 


M(z,y) dx + N(x, y) dy =0 
with 5M — &N 


. QU 
Homogeneous equation ——" + CO unless 
=U 


i F(v) 
y' =f (7) f(v) =v, in which case y = Cx. 


Linear first-order equation — f* f(t) ae | / i f* fat 
e e€ z)dz+C 
y+ fe)y = a2) a" 


Reducible to homogeneous 

(ayx + bry + cy) dx Change variables to u = ayx + bby tec 
+ (aga + boy + c2) dy =0 | and v = aor + boy +c 

with ay /a2 F by /be 

Reducible to separable 

(a,x + byy + c1) dx Change dependent variable to 

+ (agar + boy + cg) dy =0 | u(z) = ax t+ bry 

with ay /a2 = by /be 


Separation of variables dy _ rer 
yl = fa)aly) | ayn ftewre 
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5.6.3 TRANSFORM TECHNIQUES 


Transforms can sometimes be used to solve linear differential equations. Laplace 

transforms (page 508) are appropriate for initial value problems, while Fourier trans- 

forms (page 494) are appropriate for boundary value problems. 

EXAMPLE Consider the linear second order equation y” + y = p(a), with the initial 
conditions y(0) = 0 and y’(0) = 0. Multiplying this equation by e ** and integrating 
with respect to x from 0 to oo results in 


/ ey"(a)ac+ f ey(a)de = f e p(x) da. 
0 0 0 


co ~— sx 


Integrating by parts, and recognizing that Y(s) = L[y(x)] = fy° e **y(a) da is the 
Laplace transform of y, we simplify to 


(2 +1)¥(s) = | ” p(x) de = Lip). 


If p(x) = 1, then L[p(x)] = s~'. The table of Laplace transforms (entry 20 in the 
table on page 525) shows that the y(a) corresponding to Y(s) = 1/[s(1 + s”)] is 
y(x) = L7'[Y(s)] =1— cose. 


5.6.4 INTEGRATING FACTORS 


An integrating factor is a multiplicative term that makes a differential equation 
become exact; that is, form an exact differential. If the differential equation 
M(a,y) dx + N(x,y) dy = 0 is not exact (i.e., M, # N,), then it may be made 
exact by multiplying by the integrating factor. 


1 /0OM ON 
1. If W (= = ~) = f(a), a function of x alone, 
then u(x) = exp(J” f(z) dz) is an integrating factor. 


1 ( ON OM 


Ti ) = g(y), a function of y alone, 


then v(y) = exp(J” g(z) dz) is an integrating factor. 


EXAMPLE The equation 2 da +dy = Ohas {M = y/x, N = 1} and f(x) = 1/z. 


Hence u(x) = exp(” + dz) = exp (log x) = @ is an integrating factor. Multiplying 
the original equation by u(x) results in ydx + x dy = 0 or d(xy) = 0. 
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5.6.5 VARIATION OF PARAMETERS 


If the linear second order equation Liy] = y + P(ax)y’ + Q(x 
independent homogeneous solutions u(x) and v(x) (ie., Llu] = 
solution to the original equation is a by 


y(a) =—u(2) f * oa ene foe de, (5.6.6) 


where W(u,v) = uv’ -— w/v =| o i is the Wronskian. 


)y = R(a) has the 
0 = L[v}), then the 


EXAMPLE The homogeneous solutions to y” + y = csc x are u(x) = sinx and v(x) = 
cos x. Here, W(u,v) = —1. Hence, y(x) = sin x log(sin x) — x cos x. 


If the linear third order equation L[y] = y/” + Po(ax)y” + P(a)y’ (x)y 
R(a) has the homogeneous solutions y; (x), yo(x), and y3(x) (ie., Lly . 0), then 
the solution to the original equation is given by 
: Y2 Us 

Yo YS 


aera 


: = bea G3 ¥3 
W (41, 2; Y3) 


Ya 0 Ys 
: 0 U5 

la Rays | 
wi Wiceae 
7 














x + yo(x 
(5.6.7) 


we We 








+ y3( 
. W(y1, y2, 93) (y1, Y25 Y3) 


2 Y2 ¥3 
1 ¥2 YS 
ut aw 
Mi Y2 U3 


where W (y1, y2, y3) is the Wronskian. 








5.6.6 GREEN’S FUNCTIONS 


Let L[y] = f(x) be an n™ order linear differential equation with linear and homo- 
geneous boundary conditions { B;[y] = ry (ay (xo) + bi;y) (21)) = OF, for 


i=1,2,...,n. If there is a Green’s function G(x; z) that satisfies 
L|G(a; z)| = 6(a — 2), 
[G(a; z)] = 6(a — z) (5.6.8) 
B,[G(a; z)] = 0, 
where 6 is Ge s delta function, then the solution of the original system can be 
written as y(xz) = [ G(x; z) f(z) dz, integrated over an appropriate region. 


EXAMPLE  Tosolve y” = f(x) with y(0) = 0 and y(L) = 0, the appropriate Green’s 


function is P 
a2) forO <a <z, 
L ) (5.6.9) 
forz<a<L. 


Hence, the solution is 


= ‘ Mie z Zo * ae — E) z ze * a(z = b) z ze 
=[ G(x;z) f(z)d =[ r flayde+ f ZT (2) dz. 6.6.10) 
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5.6.7 TABLE OF GREEN’S FUNCTIONS 


The Green’s function is G(a, €) when x < € and G(€,x) when x > €. 
d2 

1. For the equation ae f(x) with 

dx? 








(a) y(0) = y(1) =0, G(a,€) = —(1— §)a, 
(b) y(0) =0, y'(1) =0, G(x, f) = —2, 
() y(0) =—y(1), y(0) =—y'(1), G(w,€) = —3(x — €) — g, and 
(@) y(-1) = (1) =0, G(w,§) = —3(@— €—2€ +1) 
2 
2. For the equation “4 —y = f(x) with y finite G(a,€) = —ger$. 
3. For the equation ae + k?y = f(x) with 
(a) y(0) = y(1) =0. G(x, g) = Se Aesin KO 9) 
ksink 
(6) v1) =y(andy(-1)=¥0) Gta) = REED 
P 2k sink 
4. For the equation _ — k’y = f(a) with 
_ _ __ sinhkasinh k(1 — €) 
(a) y(0) = y(1) = 90, G(z, £) =  RaREE ey 
(b) y(—1) =y(1) andy'(—1) =y/(1) Gag) =$ -PA EEF) 
5. For the equation < (<2) = f(x), with y(0) finite and y(1) = 0 
, G(z,€) =Ing 
6. For the equation <4 = f(x), with y(0) = y/(0) = y(1) = y’/(1) = 0 
: 2(€-1) 
G(x,8) = -" 5 one + 2 — 36) 


5.6.8 STOCHASTIC DIFFERENTIAL EQUATIONS 


A stochastic differential equation for the unknown X(t) has the form (here, a and b 
are given): 

dX (t) = a(X(t)) dt + b(X(t)) dB(t) (5.6.11) 
where B(t) is a Brownian motion. Brownian motion has a Gaussian probability 
distribution and independent increments. The probability density function fx (;) for 
X (t) satisfies the forward Kolmogorov equation 


c 2. 
Hx) = 237 [P(@)fxw(®)] — HF l@@Mfxw(@)]- 6.6.12) 
The conditional expectation of the function $(X (t)), which is u(t,z) = 


E[¢(X(#)) | X(0) = a], satisfies 
—u(t,x) = Cane x) + ae x) with u(0,2) = (2) 
ag Bg aga pg tt . , 


(5.6.13) 
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5.6.9 LIE GROUPS 


An algorithm for integrating second order ordinary differential equations is: 
1. Determine the admitted Lie algebra L,, where r is the dimension. 
2. Ifr < 2, then Lie groups are not useful for the given equation. 
3. If r > 2, determine a subalgebra Lz C Ly. 
4. From the commutator and pseudoscalar product, change the basis to obtain 
one of the four cases in the table below. 
. Introduce canonical variables specified by the change of basis. 
6. Integrate the new equation. Rewrite solution in terms of the original variables. 


Nn 


The invertible transformation { = 4(z, y, a), Y = w(x, y, a)} forms a | parameter 
group if 4(Z, 7, b) = O(a, y,a + b) and (Z, 7, b) = w(x, y,a + b). For small a, 

z= aa y) + O(a”) and J=ytan(z,y)+ O(a?) (5.6.14) 
If D= _ +y' x f+y" wo + ..., then the derivatives of the new variables are 


—/ = dy Dy Wx Ty be t+ yy 
dt De bx +y'by 
wa oe _ 2 y yo 2 
de Ded bs + by tee 


= D(n) = y' D(€) = Ne + (ny — En ly’ _ y’ Ey, and 
Q= D(G1) ~ y” D(€) = Nex + (2hey =, fae ly! + (yy _ 2E oy )y! 


ae (Ny — 22 — 3y'Ey)y” 
Define the infinitesimal generator X = €(z, v) bs ae Ss Ve and its prolonga- 
tions X() = X+0 go and X@) = XM4¢,9, gy7- Fora given differential equation, 
these infinitesimal generators will generate an r- “dimensional Lie group (Z,.). 
For the equation F(z, y,y’,y”) = : to be invariant under the action of the above 


group, X?) F |p_9 = 0. When F = y’ (x LM ") this determining equation is 
Naw + (2Mey — Ea )y’ + (yy —2Eoy)y” —y byy 


+ (ty — 2» — By'by) F— |e + (ny — Sela’ — 9" | fy — fa — fy =. 


Given two generators X; = &1 — +m a and X9 = & — +2 a the pseudoscalar 
product is Xi V Xo = €1 72 = fo and the commutator is [X1, X>| = X1Xo = 
XX. By changing basis any Lie algebra Lz can be changed to one of four types: 





wee 
1 


2 (5.6.16) 











Typified by 


XV X40] {X= 
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5.6.10 NAMED ORDINARY DIFFERENTIAL EQUATIONS 


I. 


2. 
3. 


10. 
11. 


12. 
13. 


Airy equation yl! = xy 
Solution: y = c; Ai(a) + c2 Bi(x) 

Bernoulli equation y= cera + b(x)y 
Bessel equation zy” + cy’ mn (A? n*)y = 0 


Solution: y = c1Jn (Ax) + C2Yn (Ax) 


. Bessel equation (transformed): x?y" + (2p + 1)ay! + (A?a?" + B?)y = 


0 
: = Av > 
Solution: y = 27? |eyJg/r | —2" ) + €2Yo/p | —@ g=V/r— Bp? 
r r 





. Bocher equation: yj” + $ maf weep — y' 
1 


@r—a1 L—-An-1 
Ao+Arat--+Ars! _ 
aay ema)" | — 
. Duffing equation y" +y+ey> =0 





. Emden—Fowler equation (xPy’)’ + 7y” = 0 
: ee 1 Py 1=p=6" 1 f 
. Hypergeometric equation: y” + — +=] f 4 ) y! 





fal BB" yy! (a—b)(b—c)(e—a) », _ 
(c a)(b=<) + Te=oyCe s+) (a—a)(a—by(a—ey! = 0 





a b ¢ 
Solution: y= P< a 6 y « (Riemann’s P function) 
al B' ry! 
. Legendre equation (1 —2?)y" — 2ry’ +n(n+1)y =0 


Solution: y = cP, (x) + c2Qn(2) 
Mathieu equation y” + (a — 2qcos2x)y = 0 
Painlevé transcendents 

(a) first y" = by? + tx 

(b) second y” = 2y2+ay+a 

(c) third =” = 4(y')° — 4y/ + Lay? +8) +73 + 2 
(d) fourth 9 oy” = + (y’)?+ ay" + dry? + 2(x? — a)y + 2 








(e) fifth 














eg tet) 6 v- Gas ar a 
Mie [a+ G+ be + GSP 


Parabolic cylinder equation y” + (ax? + br + c)y =0 
Riccati equation y! = a(x)y? + W(a)y + c(x) 
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5.6.11 TYPES OF CRITICAL POINTS 


An ODE may have several types of critical points; these include improper node, 
deficient improper node, proper node, saddle, center, and focus. See Figure 5.1. 


FIGURE 5.1 
Types of critical points. Clockwise from upper left: center, improper node, deficient improper 
node, spiral, star, and saddle. 





5.7 PARTIAL DIFFERENTIAL EQUATIONS 


5.7.1 CLASSIFICATIONS OF PDES 


Consider second order partial differential equations, with two independent variables, 
of the form 


2 2 zu Ou UL 
Aw, y) 4 + Blo, y) Ge + C(w, y) Ft = U(u, M4, S4,0,y). 6.71) 


y 
B? —4AC >0 hyperbolic 

If |B? — 4AC = 0] at some point (x, y), then Equation (5.7.1) is | parabolic | at 
B? —4AC <0 elliptic 


that point. If an equation is of the same type at all points, then the equation is simply 
of that type. 
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5.7.2. WELL-POSEDNESS OF PDES 


Partial differential equations involving u(x) usually have the following types of 
boundary conditions: 


1. Dirichlet conditions: u = 0 on the boundary 
2. Neumann conditions: = = 0 on the boundary 
n 
- Ou . 
3. Cauchy conditions: u and — specified on the boundary 


On 


A well-posed differential equation meets these conditions: 
1. The solution exists. 
2. The solution is unique. 


3. The solution is stable (i.e., the solution depends continuously on the boundary 
conditions and initial conditions). 


Type of equation 


Type of boundary | Elliptic Hyperbolic Parabolic 
conditions 


Open surface Undetermined Undetermined Unique, stable 
solution in one 
direction 

Closed surface Unique, stable Undetermined Undetermined 

solution 


Open surface Undetermined Undetermined Unique, stable 
solution in one 


direction 
Closed surface Overdetermined Overdetermined Overdetermined 
Open surface Not physical Unique, stable Overdetermined 
solution 
Closed surface Overdetermined Overdetermined Overdetermined 
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5.7.3 TRANSFORMING PARTIAL DIFFERENTIAL EQUATIONS 


To transform a partial differential equation, construct a new function which depends 
upon new variables, and then differentiate with respect to the old variables to see 
how the derivatives transform. 


EXAMPLE Consider transforming 
fax + fuy + 2fy = 9, (5.7.2) 


from the {x, y} variables to the {u, v} variables, where {u = x, v = x/y}. Note that 
the inverse transformation is given by {2 = u, y = u/v}. 
First, define g(w, v) to be the function f(x, y) when written in the new variables, 


that is 
x 


f(z, y) = 9(u,v) =9 («. =) (5.7.3) 


Now create the needed derivative terms, carefully applying the chain rule. For example, 
differentiating Equation (5.7.3) with respect to x results in 


0 a a a (« 
fc(@,y) = uae. (u) + uae (v) = 25, (x) + 9257 (£) 
1 v 
=o +g2-=91+ —-92, 
y u 


where a subscript of “1” (“2”) indicates a derivative with respect to the first (sec- 
ond) argument of the function g(u,v), that is, gi(u,v) = gu(u,v). Use of this 
“slot notation” tends to minimize errors. In like manner 


Fe) ra) 0 0 (x 
fy(v,y) = nF, (u) toe, (v) = 5, (x) va (<) 


x 0) 
== 5 = oe 
y U 


The second order derivatives can be calculated similarly: 


feelin) = (ele) = (an + 202) 


2v v 
= gil + —gi2 + 5922; 
wu u 








i ue 3 2 
sz 92 = 92 = —7 912 = — 922 
2 we ps perce? 


felon) = 3 ( y 





0 zr Qu vt 
fuy (x, y) = By eo = 72 2 af 2 


Finally, Equation (5.7.2) in the new variables has the form, 
0= fax + fyy + @fy 
2u v 2u3 vt v 
gil + —gi2 + 5922 ) + | —> 92 + 7922 | + (wu) | -—ge 
u u u u u 


2 2 2 2 
uv (2v —u 2u l+u 
= SD asst, ee pus 
U U 


U 
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5.7.4 GREEN’S FUNCTIONS 


The Green’s function, G(r; ro), of a linear differential operator L|-] is a solution of 
L[G(r; ro)] = 6(r — ro) where 0(-) is the Dirac delta function. 

In the following, r = (x,y, z), Fo = (£0, Yo, 20)» R2 = |r — rol” = (w— 2)? + 
(y — yo)” + (z — z0)*, and P? = (x — x9)? + (y — yo)”. 


1. For the potential equation V?G + k?G = —476(r — ro), with the radiation 
condition (outgoing waves only), the solution is 





271 spi : ' . 
= ¢*kl=—20l in one dimension, 
G= inH) (kP) in two dimensions, and (5.7.4) 
eikR 
R in three dimensions, 


where Ho (-) is a Hankel function (see page 460). 
2. For the n-dimensional diffusion equation 


VG- aS = 47 6(r — ro)d(t — to), (5.7.5) 





with the initial condition G = 0 fort < tg, and the boundary condition G = 0 
at r = ov, the solution is 


An a . a?|r — ro|? 
Sd ———— ———— ] oh 
aa ( =) on (aaa) ee 


V’?G -— sa = —46(r — r0)5(t — to), (5.7.7) 





with the initial conditions G = G; = 0 fort < to, and the boundary condition 
G = Oatr =o, the solution is 


2cnH c —to)- a in one space dimension, 
c 
2C P 
Ce c —to)- | in two space dimensions, and 

c?(t — tp)? — P? c 
1 
R? — — (t—to) in three space dimensions. 

c 
(5.7.8) 


where H(-) is the Heaviside function. 
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5.7.5 SEPARATION OF VARIABLES 


A solution of a linear PDE in n dimensions is attempted in the form u(x) = 
u(@1,22,°+* ,&n) = X1(x1)Xe(x2)...Xn(en). Logic may determine the {X;}. 


1. The diffusion or heat equation in a circle is 


Ou ; 10 / Ou 1 Ou 
a.” roar 


for u(t,r,@), where (7,0) are the polar coordinates. If u(t,r,0) = 
T(t)R(r)O(0), then 


dR\ 1 PQ 1dT wait 
rR adr \" dr PQ de? Td ie 


Logic about which terms depend on which variables leads to 


iar 120 d ( dR : 


where A and p are unknown constants. Solving these ordinary differential 
equations yields the general solution, 


u(t,r, 0) = [. dd - dp e-™ [Ba p) sin(/p0) + C(A, p) cos( //70)| 


x [Da. p) J yp(WXr) + E(A, p)Y, yalv>r)| . 
(5.7.11) 


Boundary conditions are required to determine the { B,C, D, EF}. 


. A necessary and sufficient condition for a system with Hamiltonian 


H = 3(p, + p,) + V(a,y), to be separable in elliptic, polar, parabolic, or 
Cartesian coordinates is that the expression, 





(Vay — Vew)(—2axy — b'y — br +d) + 2Vqy(ay? — ax? + by — b'a+c—C¢) 
+ V,(6ay + 3b) + V,(—6ax — 3b’), (5.7.12) 


vanishes for some constants (a, b, b’, c,c’, d) 4 (0,0,0,¢,¢, 0). 


. Consider the orthogonal coordinate system {ut, u?, u3}, with the metric {g;;}, 


and g = 911922933. The Staéckel matrix is defined as 


@y,(u') @yo(ut) 13(u") 
S = | ®o1(u?) Bg2(u?)  Bo3(u?) | , (9.7.13) 
@31(u?) ®32(u?) ®33(u?) 
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where the {®,;,; }, which are analogous to the {.X;} above, have been tabulated 
for many different coordinate systems. The determinant of S can be written as 
&s= 01,Mi1 + ®2,Mo + 3; M33, where 














B22 Doz Ping 13 ®12 13 
Mu = Mo, = - M3; = 
1632 B33|” a O32 033 31 1@on Boz 
(5.7.14) 


If the separability conditions, g;; = s/Mj1 and \/g/s = f1(u*) fo(u?) fs(u’), 
are met then the Helmholtz equation V?W + A?7W = 0 separates with 
W = X\(u)X2(u?)X3(u?). Here the {X;} are defined by 


1d Ss 
Fda (x =) + Xi 3° aj Gi; =0, (5.7.15) 


with a, = 7, and ay and az arbitrary. 


(a) Necessary and sufficient conditions for the separation of the Laplace 
equation (V?W = 0) are 


ae aie and v9 


= a 3) Mi. 7A 
tes Min r fi(u’) fo(u") fs(u°?)Mir. (5.7.16) 





(b) Necessary and sufficient conditions for the separation of the scalar 
Helmholtz equation are 





S 
94.= Mn and va = fi(u’) fo(u?) fs(u?) (5.7.17) 


. In parabolic coordinates {u,v,~} the metric coefficients are gi1 = g22 = 
uw? + v? and g33 = pv. Hence, \/g = uv (u? + v?). For the Stickel matrix 


jal =i? 
S=|7 1 -1/7 (5.7.18) 
0 O 1 
(for which s = pw? +v?, My, = Mo; = 1, and M3; = p~?+v~?), the separa- 
bility condition holds with f; = py, fo = v, and fz = 1. Hence, the Helmholtz 
equation separates in parabolic coordinates. The separated equations are 


1d (dx 
(u ot) +m (au? -a2~ 3) <0 
pdp \ dp pe? 


ld dX 
po | Le (av? tgs, = “)= — 0, and (5.7.19) 
v dv dv yp? 
Xz 
“dye + a3X3 => 0, 


where W = X41 (1) X2(v)X3(y). 
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5.7.6 SEPARATION OF VARIABLES FOR THE KLEIN-GORDON 
EQUATION IN 2D 

The Klein—Gordon (KG) equation for w is given by w+ pw =0, 

in coordinates u* on Minkowski space where jz = mc/h is a constant, 1 denotes the 

d’ Alembertian operator 





























w= i. (V=a 9% Ow), 
g is the determinant of the matrix representing the metric tensor g;; in coordinates 
u’, and g’) are the components of its inverse. 

Now set ut = u, and u? = v. Listed below are the orthogonal coordinate sys- 
tems for which the 2-dimensional KG equation admits product separable solutions 
of the form w(u,v) = X(u)Y(v). For coordinate systems 1-10 below, except for 
number 2, the metric tensor is in Liouville form: gi; = —(A(u) + B(v)) = —g22, 
and Gi2 = 0. 

The Klein—Gordon equation is these cases can be written as 


O?w i O2w 
~— Ou2 * Av? 











) + w?(A+ B)yw =0. 


Substituting w = XY in the KG equation results in 
YX"(u) — XY" (v) — p?(A+ B)XY =0, 


which, upon division by XY, is clearly separable. The KG equation is also clearly 
separable for coordinate system number 2 which is not, however, in Liouville form. 


1. Cartesian coordinates 
Relations: =u, x=v 
Ranges: —co <u< oo, -—o<u< oo 
Juu = —Jov = —1, V-9 =1 
2. Rindler coordinates 
(a) for —t? + x? <0: 
Relations: t = ucoshv, «= usinhv 
Ranges:0<u<oo, —oo <u< oo 
Juu = —1, due =U", V-g=u 
(b) for —t? + 2? > 0: 
Relations: ¢ = usinhv, 2 =ucoshv 
Ranges:0 << u<oo, —oo <u<oo 


Guu =1, Juv = —u’, v-g=u 


3. Real elliptic coordinates of type I 
Relations: t= acoshusinhv, x=asinhucoshv, O0<a 
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Ranges:0 <<u<o, O0<vu<@ 
Juu = —Jvv = a? (cosh? u+sinh? v), /—g = a?(cosh? u+ sinh? v) 


4. Real elliptic coordinates of type II 
(a) for |t] — |x| > a: 
Relations: t = acoshucoshv, w«=asinhvsinhu, O<a 
Ranges: 0 < u < v < 00 
Juu = —Jvv = a?(cosh? v — cosh? wu), 
/—g = a? (cosh? v — cosh? u) 
(b) for |t] — || < —a: 
Relations: t= asinhusinhv, «=acoshvcoshu, O<a 
Ranges: 0 <u <u< oo 
Juu = —Jvv = a?(cosh? u — cosh? v), 
V/—g = a?(cosh? u — cosh? v) 
(c) for |t| + |a| <a: 
Relations: t= acosucosv, v=asinusinu, O<a 
Ranges: 0 <u<u< 4 
Juu = —Jvv = a?(cos? u—cos?v), /—g = a? (cos? u — cos? v) 


5. Complex elliptic coordinates 
Relations: t— 7 =acosh(u+v), t+a=asinh(u—v), O<a 
Ranges: 0 < |v| <u < co 
Juu = —Jvv = a7(sinh2u+sinh2v), /—g = a?(sinh 2u + sinh 2v) 
6. Null elliptic coordinates of type I 
Relations: t— 2 =e"t”, t+a2 = 2sinh(u-—v) 
Ranges: -co <<u< ow, —-w<u<o 
Guu = —9ve = eu + e2”, J/-9 = ecu + e2” 
7. Null elliptic coordinates of type II 
(a) for —é? + 2? > |é — a|: 
Relations: t— 2 = —e“t®, t+a = 2cosh(u—v) 
Ranges: —co <u <u<o 
Suu = —Guv = e2u _ e?”, /-9 _ ez _ e2¥ 
(b) for —t? + x? < —|t— a: 
Relations: t-—x=e"t’, t+a=2cosh(u—v) 
Ranges: —oo <u <u <0 
Suu = —Guv = e2 _ et, J-9 = ez = e2u 


8. Timelike parabolic coordinates 
Relations: t = $(u?+v?), «=u 
Ranges: 0 <u <u< oo 
Juu = —Gu» = —(u? — 0”), V-9= wu? —v? 
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9. Spacelike parabolic coordinates 
Relations: t= uv, x = $(u? +”) 


Ranwes: 024 w< 66 
Guu = —Guy = uw? — v?, J/-g =u —v? 


10. Null parabolic coordinates 
Relations: t+ 2 =—(u+v), t-x2=$(u-v)? 
Ranges: 0 < |v| <u < co 
Juu = Juv =—(U-v), V-g=u-v 
The following graphics show the above coordinate systems.! The empty white spaces 
are open regions which are not covered by the coordinate system. 








1. Cartesian 5. Complex Elliptic 8. Timelike Parabolic 
7 7 
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3. Real Elliptic I 7. Null Elliptic II 10. Null Parabolic 
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‘Reprinted with permission from: K. Rajaratnam, R. G. McLenaghan, and C. Valero, Orthogonal 
Separation of the Hamilton-Jacobi Equation on Spaces of Constant Curvature, SIGMA 12 (2016), 117, 
30 pages, https: //arxiv.org/abs/1607 .00712. 
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5.7.7 SOLUTIONS TO THE WAVE EQUATION 


1. Consider the wave equation ea = V7u = £ apo sespe os with x = 
(@1,...,@) and the initial data u(0,x) = f(x) and uz(0,x) = g(x). When n 


is odd (and n > 3), the solution is 


1 a a (n—3)/2 = 
ux) = fF (=) t w(f;x, ¢] 


Fa) (n—3)/2 
+ (=) Clg a} 
tot ? o] ? 


where w[h;x,t] is the average of the function h(x) over the surface of 
an n-dimensional sphere of radius ¢ centered at x; that is, w[h;x,t] = 
soy J ng) aQ, where |¢ — x|? = t?, o,_1(t) is the surface area of the 
n-dimensional sphere of radius t, and dQ is an element of area. 


(5.7.20) 


When n is even, the solution is given by 
(n—2)/2 pt p” 1 
uo =o fF (2) [vite 
2-4---(n—2) | Ot \ tot s/t? — p? 
a (n—2)/2 pt n—1 g 
a (=) i wg; x, Is Z \ 
vip 


(5.7.21) 


where w[h; x, t] is defined as above. Since this expression is integrated over 
p, the values of f and g must be known everywhere in the interior of the 
n-dimensional sphere. 


Using uy, for the solution in n dimensions, the above simplify to 


1 att 
us (2,t) = i le) +Fe+o)+5 fad, 6.7.22) 
f(x1 = + f(@it+G, #2 +) 
=a ff eS oe 
R(t) 
ol ore g{ta + = +) a6, dep, and (5.7.23) 
Je-@-G 

us(X, t) = Bas a + tolg;x,t], (5.7.24) 


where R(t) is the region {(¢1, 2) | ¢? + G} < t?} and 


20 
w[h:x, t] = af fn (a1 +tsin@ cos ¢,r2 + tsin@singd, (5.7.95) 


x3 +tcos6) x sind dé dd. 
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2. The solution of the one-dimensional wave equation 


aoe. 
Vtt = C Vara 


v(0,t) =0, for0<<t<a, (5.7.26) 
v(x, 0) = f(a), forO<u<o, 
vr(x, 0) = g(x), for0 <a <0, 











u(x,) = plf(et et) + fle—t)] + x Jer 9(0) dC, fora > ct, 

4 [f(~@ + ct) — f(t —ax)] + — tes g(¢)d¢, fora < ct. 
(5.7.27) 

3. The solution of the inhomogeneous wave equation 
fu Ou Pu Hu 

ap Ao a a = FE 7.2 

Ot? = Ox? Oy? Oz? (t,2,4, 2), (G.7.28) 
with the initial conditions u(0, x, y, z) = 0 and uz (0, x, y, z) = 0, is 
F(t 

u(t, yz) = 7 ~ [ {ff eene ae ®) ac andé, (5.7.29) 


pct 


with p = \/(x —C¢)? + (y—n)? + (z- €)?. 


5.7.8 SOLUTIONS OF LAPLACE’S EQUATION 
1. If V2u = 0 ina circle of radius R and u(R,0) = f(0), for 0 < 6 < 2r, then 
u(r, 0) is 


tL R? —r? 
ue.) = 35 f TeTaRrone saa foes 


2. If V?u = 0 ina sphere of radius one and u(1,0,¢) = f(0,¢), then 


2r 2 
1% 
0, (0, ®) —_____________ sin 0 dO.d®, 
ue) = zi f A ae 2)3/2 = 
where cos y = eeheai + sin 6 sin © cos(¢ — ®). 
3. If V7u = 0 in the half plane y > 0, and u(x, 0) = f(a), then 
1s? f(t 
u(ey) =~ fH 


|. @— te +H 


4. If V7u = 0 in the half space z > 0, and u(z, y,0) = f(z, y), then 


f(Gm) 
(2, y, 2 = oe =f [. [e024 (y—n)? +2)” d¢ dn. 
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5.7.9 QUASI-LINEAR EQUATIONS 


Consider the first-order quasi-linear differential equation for u(x) = u(v1,...,0N), 

a1 (X, U)Ue, + a(x, UUs, +--+ + aN (X,U)Ucy = b(x, wu). (5.7.30) 
Defining a = a,(x, u), fork = 1,2,...,.N, this equation becomes — = D(x, u). 
The initial conditions can often be parameterized as (with t = (t1,...,t~—1)) 


u(s = 0, t) _ v(t), 
xi(s = 0,t) = hi(t), 
r2(s = 0,t) = he(t), (5.7.31) 


tn(s =0,t) = hn(t), 


To solve the original equation, the differential equations for u(s, t) and the {x;,(s, t)} 
must be solved; these are the characteristic equations. This often results in an im- 
plicit solution. 


EXAMPLES 


e Consider the wave equation cuz + Uy = O, where c is a constant, with « = xo and 
u = f (xo) when y = 0. The characteristic equations are 
Ox 0 du 
Ss C, ae = 1, —=0. 
Os Os ds 
with the conditions 


y(s = 0) = 0, x(s =0) = 2o, u(s = 0) = f(zo). 





The solutions of these equations are: yY=s8, v=%X0+ Cs, u = f(x). 
These can be combined to obtain u= f(xo) = f(a — cs) = f(x — cy), 
which represents a traveling wave. 
e Consider the equation u,+27?u, = —yu with u = f(y) when x = 0. The characteristic 

equations are 

Ox Oy 2 du 

= = if “fy — = —yu. 

Os : as? ds ae 


The original initial data can be written parametrically as 


x(s = 0,t1) = 0, y(s = 0, t1) = ti; u(s = 0,ti) = f(t1). 
Solving for x results in x(s,t1) = s. The equation for y is then integrated to ob- 
tain y(s,t1) = = + t,. Then the equation for u is integrated to obtain u(s,ti) = 
f (ti) exp(— - st). These solutions constitute an implicit solution of the original 
system. 
In this case, it is possible to eliminate the s and ¢1 variables analytically to obtain the 


x x4 
explicit solution: u(x, y) = i(y - =) e(> - wy). 
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5.7.10 PARTICULAR SOLUTIONS TO TWO PDES 


In these tables, P(x) is a polynomial of degree n. 
A solution to z; + mzy = R(a, y) is 

(1) | e ett +by /(q + mb). 

(2) ; fo f(u) du/(a+ mb). 

(3) = f(y — mz). 

(4) - evaluate f(y — ma) [ (a, a + ma) da; 
then substitute a = y — mz. 

A solution to zz + mzy — kz = R(x, y) is 
(Sy | corre erty /(q + mb —k). 


_ (atbm) cos(aa+by)+k sin(ax-+by) 
(a+bm)?+k? : 


(6) | sin(ax + by) 





(7) | e°*+®¥ sin(ax + by) | Replace k by k — a — m@ in formula (6) 


and multiply by e%*+°¥, 


(8) | e** f(ax + by) eke f f(y) du/(a+mb), u=ax + by. 
(9) | f(y — ma) — —mea)/k. 
(10) P(x) fly se max) ae tf (y— max) [P(x)+ Pio Pw. ae) 


(11) | e** f(y — mz) xe** f(y — mz). 





5.7.11 NAMED PARTIAL DIFFERENTIAL EQUATIONS 








1. Biharmonic equation: Vtu=0 
2. Burgers’ equation: Ut + UUg = VUge 
3. Diffusion (or heat) equation: = V(c(x,t)Vu) = uz 
4. Hamilton-Jacobi equation: Vi + A(t, x, Vo,,...,Ve,,) =0 
5. Helmholtz equation: V7u+ k?u=0 
6. Korteweg de Vries equation: Ut + Ugen — Guu, = 0 
7. Laplace’s equation: V2u =0 
8. Navier-Stokes equations: u,t+(u-V)u= == +vV7u 
9. Poisson equation: V2u = —4mp(x) 
10. Schrédinger equation: -F yu +V(x)u = ihuz 
11. Sine—Gordon equation: Ura — Uyy = sinu = 0 
12. Telegraph equation: Une = AUtt + buy + cu 
13. Tricomi equation: Uyy = YUre 
14. Wave equation: CV2u = Unt 
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5.8 INTEGRAL EQUATIONS 


b(x) 
h(x)u(x) = f(x) + | k(ax,t)G[u(t); ¢] dt. 


5.8.1. DEFINITIONS 


1. Terms in an integral equation 


e k(a,t) kernel 

e u(x) function to be determined 
e h(x), f(x), d(x), G[z, t] given functions 

e \ eigenvalue 


2. Classification of integral equations 


(a) First kind h(a) = 

(b) Second kind h(x) = 

(c) Third kind h(a) # constant 
(d) Fredholm b(x) =b 

(e) Homogeneous f(x) =0 

(f) Linear Glu(a); 2] = u(x) 





(g) Singular a=—oo, d(x) = co 
(h) Volterra b(a) =a 
3. Classification of kernels 
(a) Symmetric k(a,t) = k(t, x) 
(b) Hermitian k(a,t) = k(t, x) 
(c) Separable/degenerate Rat) = YO 2 bE), <6 
(d) Difference k(a,t) = k(a —t) 
(e) Cauchy k(a,t)= <4 
(f) Singular k(x,t) > ooast >a 
(g) Hilbert-Schmidt f? f° |k(@, t)P dx dt < 00 


5.8.2 CONNECTION TO DIFFERENTIAL EQUATIONS 
The initial value problem 


u(x) + A(x)u'(x) + B(x)u(x) = g(x), w>a, 


male, -w'(a)= cy, 


(5.8.1) 
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is equivalent to the Volterra integral equation, 


u(x) = f(x) + [ k(x, t)u(t) dt, «v>a, 

















fla) = [(@-tglhat+(e-a)lAf@ertalta, 68) 
h(a, t) = (t— 2)[B(t) — A'()] - Al. 
The boundary value problem 
u(x) + A(a)u'(x) + Blx)u(z) = g(@), a<a<d, (5.8.3) 
u(a)=c1, ul(b) =e, _ 
is equivalent to the Fredholm integral equation 
b 
u(x) = f(x) +f k(x, t)u(t) dt, a<ac<b, 
x b 
fle) =a+ f (e-glt)at + - -a- | b-H9( | , 
wla,t) = [EHAO-@-914'O- BOD, e> 
jaa (A(t) — (b— t)[A(t) -— BO}, a<t 
(5.8.4) 
5.8.3 SPECIAL EQUATIONS WITH SOLUTIONS 
1. Generalized Abel equation: . Soe = f(x) 
a _ sin(at) d [* — h'(t)f(t)dt 
The solution is u(a) = = a [a(a) — A= 
whereO < a < 1,0<a<1,0 < A(x) < 1, h(x) > 0, and h’(z) is 
continuous. 
. t u(t) 
2. Cauchy equation: pu(a) = f(x) +f a dt. 
The solution is ° 
eee’) 1 s = 
EL} ds ; | t “a dt, wee, 
w=) @ wh Cah Gp 
(1 —a)7sin“(ay) d ds (1—t)-7f(t) a 0 
7m a = 0, ear tee 
(5.8.6) 


where 0 < x < 1, wis real, wp A 0, |u| = mcot(ry), 0 < y < 1/2, and the 
integral is a Cauchy principal value integral. 
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. Volterra equation with difference kernel: 
u(x) = f(a) +A fo K(a — thu(t) dt. 
: : — p-l 
The solution is u(a%) =L Tus) ae ; 
for x > 0, £[f(x)] = F(s) and £ [k(x)] = K(s). 


. Singular equation with difference kernel: 
u(x) = f(x) +A fo. k(w — t)u(t) de. 
1 =; F(a) 
1a d 
Van |. © T=2K(@) 
where —0co < & < co, F(a) = F [f(x)| and K(a) = F {k(«)| 


The solution is u(x) = 


. Fredholm equation with separable kernel: 
ule) = fw) + - Sar 24 (be (tule) at. 
The solution is u(x) y+ s Chan (a 


with mn = fb pean t) dt wherea < x < b, 
n<oo,andm=1,2,...,n eee page 494). 
. Fredholm equation with symmetric kernel: 


Solve tn (a) = An f” k(a, t)un(t) dt for {un, An }n=1,2,.... Then 


mieten 


(a) For A 4 Xp, solution is u(x) = f(a) +A > tin(2) Ja f(un(t) dt 
. fal On —d) fi u(t) dt 
(b) For A = A, and is i f(t)um(t) dt = 0 for ae m, solutions are 


oy tak (t)Un(t) dt 
u(x) = f(x) + cum(x) + Am yee 
nzm 


form =1,2,.... 
where a < a < b, and k(x,t) = k(t, x) (see Section 5.8.4). 


. Volterra equation of second kind: 


u(z) = f(a) +A f* k(a, t)u(t) dt. 
The solution is u(x) = peal - N" kin +i (a, t) f(t) dt, 


where ky(x,t) = k(x,t), kn41 (a, t) = (Pr kin(s,t) ds, when k(a, t) 
and f (a) are continuous, \ # 0, and x > a. 
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5.8.4 FREDHOLM ALTERNATIVE 


For u(x) = f(x)+A ie k(ax,t)u(t) dt with A ¥ 0, consider the solutions to uy (x) = 
df? k(x, t)un(t) dt. 


1. If the only solution is uz(x) = 0, then there is a mene solution u(x). 
2. If ux(a) A 0, then there is no solution unless fr ui, (t) f(t) dt = 0 for all 


uj,(a) such that u7,(z) = = ff k(t,x)uy,(t) dt. In this case, there are in- 
finitely many solutions. 





5.9 TENSOR ANALYSIS 


5.9.1 


DEFINITIONS 


1. An n-dimensional coordinate manifold of class Ck k>1l,isa point set MW 


together with the totality of allowable coordinate systems on /. An allowable 
coordinate system (¢,U) on M is a one-to-one mapping ¢ : U + M, where 


U is an open subset of R”. The n-tuple (a1,...,2”) € U give the coordinates 

of the corresponding point ¢(z!,...,2") € M. 

If (6, U ) is a second coordinate system on MM, then the one-to-one cor- 

respondence o-! og : U + U, called a coordinate transforma- 

Hon on sag is assumed to be of class C*. It may be written as 
fi(at,...,0"), i = 1,...,n,where the f are defined by (¢7! 


Beet) o HaN. at) Pet) 


The coordinate transformation ¢ ) 6 has inverse ¢~! 0 d, tied in 


terms of the coordinates as x’ = f’(Z',...,@"), i=1,.. 

. In the Einstein summation convention, a ‘aaenedied upper anid ie index sig- 
nifies summation over the range k = 1,...,n. 

. The Jacobian matrix of the Hanstonauce, oe satisfies oe Oz = i and 


Ox* Ozx* 
Oz* OxI 
also that det (5 ) #0. 


1, 
0, ve 


= 5, where oy = { ~ 4 denotes the Kronecker delta. Note 


. A function F : M — Ris called a scalar invariant on M. The coordinate rep- 


resentation of F in any coordinate system (@, U) is defined by f := Fod. The 
coordinate representations i of F with respect to a second coordinate syst 
(6, U) is related to f by f(Z!,...,@") = f(fi(#,...,#"),...,f"(#! 
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5. A mixed tensor T of contravariant valence r, covariant valence s, and weight 
w at p © M, called a tensor of type (r,s, w), is an object which, with respect 
to each coordinate system on M, is represented by n”** real numbers whose 
values in any two coordinate systems, @ and d, are related by 


Fi ip Ci Mees, Ox 0%" Ox — Oars 
ape soda = [det ( =) | oe cg 





Jt O02 fbs Qyki Oxkr OXI OXI: 
eK.S$_SEO ee 
r factors s factors 
(5.9.1) 


The superscripts are called contravariant indices and the subscripts covariant 
indices. If w # 0, then T is said to be a relative tensor. If w = 0, then 
T is said to be an absolute tensor or a tensor of type (r,s). In this section 
only absolute tensors, which will be called tensors, will be considered unless 
otherwise indicated. A tensor field T of type (r, s) is an assignment of a tensor 
of type (r,s) to each point of M. A tensor field T is C* if its component 
functions are C* for every coordinate system on M. 

6. A parameterized curve on M is a mapping y : I + M, where J C Ris some 
interval. The coordinate representation of y in any coordinate system (¢, U) 
is a mapping g : I + R” defined by g = ¢~! 0 y. The mapping g defines a 
parameterized curve in R". The component functions of g denoted by g’ (for 
i = 1,...,n) are defined by g(t) = (g1(t),--- ,g”(t)). The curve y is C* 
if and only if the functions g’ are C* for every coordinate system on M. The 
coordinate representation g of 7 with respect to a second coordinate system 


(6, i) is related to g by g(t) = fi(gX(t),--- .9"(t)). 


5.9.2 ALGEBRAIC TENSOR OPERATIONS 


1. Addition: The components of the sum of the tensors T, and T> of type (r,s) 
are given by 


ee Se eee (5.9.2) 


Gisvds fics fide” 


2. Multiplication: The components of the tensor or outer product of a tensor T\ 
of type (r,s) and a tensor T> of type (t, uw) are given by 


iyevipky--ke = yep ky-+-ke 
T; (ities = Heads ak? (5.9.3) 
3. Contraction: The components of the contraction of the t contravariant index 


with the u"" covariant index of a tensor T of type (r,s), with rs 4 0, are given 

by T tye te-kttqicctr 
y JavJu-1kjupie js’ 

4. Permutation of indices: Let T be any tensor of type (0,7) and S;,. the group 

of permutations of the set {1,--- , 7}. The components of the tensor, obtained 

by permuting the indices of T with any o € S,., are given by (oT)j,...i,. = 
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Tig 1) iar): The symmetric part of T, denoted by S(T), is the tensor whose 
components are given by 
1 
SU int = Vee a > Da iied es (5.9.4) 
eS, 


The tensor T’ is said to be symmetric if and only if 7;,...;. = T(i,..-i,). The 
skew symmetric part of T, denoted by A(T), is the tensor whose components 
are given by 


i: 
AD igi = Tay = a SSE) peas (5.9.5) 
“GES, 
where sgn(a) = +1 according to whether o is an even or odd permutation. 





The tensor T’ is said to be skew symmetric if and only if Tj,...4,. = Thi,...i,]- If 
r=2,S(T)iig = een + Ti,i,) and A(T) iis = ieee = Tiga) 


5.9.3 DIFFERENTIATION OF TENSORS 


1. In tensor analysis, a comma is used to denote partial differentiation and a semi- 


colon to denote covariant differentiation. 


2. A linear connection V at p € M is an object which, with respect to each 


coordinate system on M, is represented by n? real numbers i x» called the 


connection coefficients, whose values in any two coordinate systems ¢@ and ¢ 
are related by 


~; Ox Ox™ Ox” Oa’ az! 
= 1 


™” Bal Bat OER * BEIOEF Oak eae 


The quantities , are not the components of a tensor of type (1, 2). A linear 
connection V on M is an assignment of a linear connection to each point 
of M. A connection V is C* if its connection coefficients I, are C* in 
every coordinate system on M. 


The components of the covariant derivative of a tensor field T of type (r, s), 
with respect to a connection V, are given by 


hr __ dyer an Li2++-4p 
VR ay OR” ag a eg (3.97) 
in tpt e _ pe iyedy _.._ pe iyeedp 
+P At ney" pk Maks Vike | deal 
tye tp 
where Pir te itr = OT jieds 
k ede jivvje,k Oxk 5 


This formula has this structure: 
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(a) A partial derivative term, a negative affine term for each covariant index 
and a positive affine term for each contravariant index. 


(b) The second subscript in the [-symbols is always the differentiated index 
(k in this case). 


. Let Y*(t) be a contravariant vector field and Z;(t) a covariant vector field 
defined along a parameterized curve y. The absolute covariant derivatives of 
Y* and Z; are defined as follows: 











6y? _ dy? Tin yi da* 

ot dt at dt (5.9.8) 
: 9. 

ot dt pee ae 


where x’ denotes the components of ¥ in the coordinate system ¢. This deriva- 
tive may also be defined for tensor fields of type (7, s) defined along +. 


. A parameterized curve y in I is said to be an affinely parameterized geodesic 
if the component functions of + satisfy 


6 eS) _ a! Tr dx) dax* 
~ "de Tat “dt 


ot 


which is equivalent to the statement that the tangent vector 4 “to 7 is parallel 
along ¥. 


iti : sc OY? __ 
. A vector field Y"(t) is parallel along a parameterized curve y if [- = 0. 


. The components of the torsion tensor S of V on M are defined by 

Sti, =I" y, — Tey: (5.9.9) 

. The components of the curvature tensor R of V on M are defined by 
Ripe = OnT gg — Oly +P ae — AT me: (5.9.10) 

(In some references RF is defined with the opposite sign.) 


. The Ricci tensor of V is defined by Rj, = Reine. 
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5.9.4 METRIC TENSOR 


1. A covariant metric tensor field on M is a tensor field g;; which satisfies 


gij = gj: and g = det(gi;) 4 0 on M. The contravariant metric g'! sat- 
isfies g'*9,; = 6;. The line element is expressible in terms of the metric 
tensor as ds? = g;;dx'dx!. 


. Signature of the metric: For each p € M, a coordinate system exists such 


that g;;(p) = diag (1,--- ,1,-1,--- ,—1). The signature of g;; is defined 
See Senn’ 
r n= 

by s = 2r —n. It is independent of the coordinate system in which g;;(p) 
has the above diagonal form and is the same at every p € M. A metric is 
said to be positive definite if s = n. A manifold, admitting a positive definite 
metric, is called a Riemannian manifold. A metric is said to be indefinite if 
s #£nands ~ —n. A manifold, admitting an indefinite metric, is called a 
pseudo-Riemannian manifold. If s = 2 — n or n — 2, the metric is said to be 
Lorentzian and the corresponding manifold is called a Lorentzian manifold. 


. The inner product of a pair of vectors X* and Y? is given by g;;X'Y!. If 


X' = Y", then g;;X'X/ defines the “square” of the length of X*. If g;; is 
positive definite, then g;;X’XI > 0 for all X*, and g;;X'X/) = 0 if and 
only if X* = 0. In the positive definite case, the angle 0 between two tangent 
vectors X* and Y! is defined by cos @ = Gig XY | (gig PX Oa ¥ OY )2. 
If g is indefinite, g;;X’X/ may have a positive, negative, or zero value. A 
non-zero vector X°, satisfying g;;X’XI = 0, is called a null vector. If gi; is 
indefinite, it is not possible in general to define the angle between two tangent 
vectors. 


. Operation of lowering indices: The components of the tensor resulting from 


lowering the t' contravariant index of a tensor T of type (r,s), with r > 1, 
are given by 


pit tepicty 


ee gr ee (5.9.11) 


Juevds* 


. Operation of raising indices: The components of the tensor resulting from 


raising the t' covariant index of a tensor T of type (r,s), with s > 1, are 
given by 


pti je eS gith pi tr (5.9.12) 


JivJt-1-° Jtpae Jie Se-tkjtpie ds" 


. The arc length of a parameterized curve y : I + M, where I = [a,b], and d 


is any coordinate system, is defined by 


b 
L=f 
dx’ 


where € = sgn(gij@'¢?) = t1land a! = &., 





egij(al(t),--- , a" (t))aras dt, (5.9.13) 
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5.9.5 RESULTS 
The following results hold on any manifold 7 admitting any connection V: 


1. The covariant derivative operator V;, is linear with respect to tensor addition, 
satisfies the product rule with respect to tensor multiplication, and commutes 
with contractions of tensors. 


2. If T is any tensor of type (0,7), then 
1 (ce t 
Vo Lis ie] = Tis-insk] — 5 (s [irk \elioép] bo7° +S a) , 


where | | indicates that the enclosed indices are excluded from the symmetriza- 
tion. Thus Tj;,,...;,.,4) defines a tensor of type (0,r + 1), and Vi_Tj,...i,) = 
Ty4,..-i,,k] in the torsion free case. If T; = Vj f = f,;, where f is any scalar in- 
variant, then Vj; V jj = sh ns" ,;. In the torsion free case, V;V; f = Vj Vif. 


3. If X* is any contravariant vector field on M, then the identity 2V ij VEX a4 
Vex'S’,, = X*R'p;,, called the Ricci identity, reduces to 2V,;V4jX' = 
Rip X © in the torsion free case. If Y; is any covariant vector field, the Ricci 
identity has the form 2ViV 5 Yk — VY, S4, = -Y/R4,, i The Ricci identity 
may be extended to tensor fields of type (r, 5). For the tensor field T%,;,, t has 
the form 


QV NG ne = Vil eG = i ng HT a aE le 
If g is any metric tensor field, the above identity implies that 
Reizyne = VikVqgig — 3V m9 8 be 
4. The torsion tensor S and curvature tensor R satisfy the following identities: 
S" ky = 9; O = Ri yam) — inte rays (5.9.14) 
Ri ce) = 0, Ryne = — Suri + S mpgs" ha- (5.9.15) 
In the torsion free case, these identities reduce to the cyclical identity RY ae 
0 and Bianchi’s identity Reem] =0. 
The following results hold for any pseudo-Riemannian manifold M with a metric 
tensor field g;;: 


5. A unique connection V called the Levi—Civita or pseudo-Riemannian con- 
nection with vanishing torsion (S";,, = 0) exists that satisfies Vigjx = 0. 
It follows that Vigh® = 0. The connection coefficients of V, called the 
Christoffel symbols of the second kind, are given by I", = g'*[jk, €, where 
Lik, 4] = $(9je,4 + 9re,j — 9jk,e) are the Christoffel symbols of the first kind. 
P*,, = £0;(log g) = Igl-2djlgl# and giz. = [hij] + (hj, 
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. The operations of raising and lowering indices commute with the covariant 


derivative. For example if X; = 9;;X/, then Vi.Xi = gijVnX?. 


. The divergence of a vector X‘ is given by ViX? = |g|~20;(|g|?-X°). 


The Laplacian of a scalar invariant f is given by Af = g!ViVjf = 
i oe 
Vilg’ Vif) = lg? Oi(lg|? 9°70; f). 


. The equarons of an anne parameterized geodesic may be written as 


4 (git Da 395k, 4a) 2 = 0, 


. Let X* and Y* be the components of any vector ae which are propagated 


in parallel along any parameterized curve 7. Then 4 (gi X' ¥?) =, which 
implies that the inner product g;;X'Y? is constant lene y. In particular, if x’ 
are the components of the tangent vector to 7, then g;;7’< is constant along ¥. 
The Riemann tensor, defined by Rijxe = Gim Re pg, 1S given by 


Rijre = (94, t],6 —Vk, te +i, MIU, — lik, mI Ge 





1 
- 5 it,sk + Ijk,ie — Jjtik — Gik,je) on 
ey g”” ((ie, m] [jk, n| — lik, m| [i2, n]). 


It has the following symmetries: 
Rij(ne) = Reizyre =9, Rijne = Reig, and Rijpgq =O. (5.9.17) 


Consequently it has a maximum of n?(n? — 1)/12 independent components. 
The equations R;;.~¢ = 0 are necessary and sufficient conditions for M to be 
a flat pseudo-Riemannian manifold, that is, a manifold for which a coordinate 
system exists so that the components g;; are constant on M. 

The Ricci tensor is given by 


Rig = OjT%, — O0*%, +T*04; —T4 Tee 
1 
= = 5a 8; (log |g|) — ale j On (log |g|) — nT, +i nT ;- 


It possesses the symmetry R;; = R;;, and thus has a maximum of n(n + 1)/2 
independent components. 

The scalar curvature or curvature invariant is defined by R = g‘ Tey. 

The Einstein tensor is defined by Gi; = Ri; — $RGij. In view of the Bianchi 
identity, it satisfies: g*V;Gy; = 0. 


0 
A normal coordinate system with origin x9¢M is defined by 9;; 27 = g;;x’, 
where a “0” affixed over a quantity indicates that the quantity is evaluated 


0 
at xo. The connection coefficients satisfy I" (;, j....j,) = 0 Gor r = 2,3,4,...) 
in any normal coordinate system. The equations of the geodesics through xo 
are given by x = sk’, where s is an affine parameter and k* is any constant 
vector. 
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5.9.6 EXAMPLES OF TENSORS 


1. 


The components of the gradient of a scalar invariant 5+; £ define a tensor of 


type (0,1), since they transform as # if = oh a Laie 


The components of the tangent vector to a parameterized curve co define a 


tensor of type (1,0), because they transform as = = — 


The determinant of the metric tensor g defines a relative scalar invariant of 

g. 

The Kronecker deltas 6! are the components of a constant absolute tensor of 
‘ at £ 

type (1,1), because 55 = poe oe 

The permutation symbol defined by 





weight of w = 2, because it transforms as g = Ea 





1, if 71 ---%p is an even permutation of 1---n 
Ciy--in = ( —1, if i.---in is an odd permutation of 1---n, and (5.9.18) 
0 otherwise, 
Ox'l Ox 


Ox" a te 
satisfies = Sat | en jin = Cir--in Zan **' Bein Hence it defines a tensor of type 


(0, , —1), that is, it is a relative tensor of weight w = —1. The contravariant 
permutation symbol e!’», defined in a similar way, is a relative tensor of 
weight w = 1. 

The Levi-Civita symbol, ¢;,...;,, = |g|?ei,...:,. defines a covariant absolute 
tensor of valence n. The contravariant Levi—Civita tensor satisfies 





g\-ze2m, (5.9.19) 





aed i197 ind ne 
el nm — gt are ee Mica 3 her = (-1) 2 


Using this symbol, the dual of a covariant skew-symmetric tensor of valence 


r is defined by *Tj,..4,_. = qe, og Tidy: 
Cartesian tensors: Let M = E? (i.e., Euclidean 3 space) with metric tensor 
gij = Oi; with respect to Cartesian coordinates. The components of a Carte- 


sian tensor of valence r transform as 


fee = DFG Oa ene 0:53 (5.9.20) 
where O;,; are the components of a constant orthogonal matrix which satisfies 
(O-');; = (O");; = O,;. For Cartesian tensors, all indices are written as co- 
variant, because no distinction is required between covariant and contravariant 
indices. 

Note the useful relations: €:;x€kim = Oidjm — SimOjl, ExklEklm = 20im, and 
€ijkElmn = dit0jmOkn T dimOjnOkl + din djlOkm a dinOjmOl dimOjlOkn = 
bit0jnOkm:- 

Polar coordinates: The line element is given by ds? = dr? + r?d0?. Thus 
the metric tensor is gj; = C 5 ), and the non-zero Christoffel symbols are 


[21,2] = [12, 2) = —[22, 1) =r. 
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10. Orthogonal curvilinear coordinates: Let M be a 3-dimensional Riemannian 


manifold admitting a coordinate system (x, x”, x] such that the metric tensor 


has the form gj, = h? (x1, x?, 2°) fori =1,...,3 with 9; = g =O fori 4 
j. The metric tensor on E® has this form with respect to orthogonal curvilinear 
coordinates. The non-zero components of various quantities corresponding to 


this metric are: 


(a) Covariant metric tensor 
2 2 2 
gu =hr’, 922 = he", 933 = hs (5.9.21) 
(b) Contravariant metric tensor 


: hi’. go = ho? 


33 _ p,~? (5.9.22) 


? 


(c) Christoffel symbols of the first kind (note that [i7,k] = 0 if i, 7, and k 
are all different), 


(11, 1] = Arhia [11,2] =—hihig [11,3] = hihi 
[12,1] = hihi (12, 2] = hoho1 (13, 1] = hihi 
[13, 3] = h3h31 [22,1] =—hohe1 [22,2] = Rohe 
[22,3] =—hoho3 [23,2] = haha (23, 3] = h3h3.2 
[33,1] = —hsh31 [83,2] =—Aghs2 —«[33, 3] = hgh3,3. 


(d) Christoffel symbols of the second kind (note that rs, = Oif i,j, andk 
are all different), 


Th, =f haga Ti, =hi ‘hie Ti,=hi ‘hia 
The = hi *hehas 43 = —hi 7hahaa 24, = —Aihe 7hi2 
P45 = he “hat P39 = he hae T= he thas 
T’,,=—ho "hahso 3, —=—hih3 "hs T43 =he ‘har 
P34. = —heh3 "hog 43 = hs 'hs2 [3 =hs ha 


(e) Vanishing Riemann tensor conditions (Lamé equations), 

hi2,3 — ho ‘hizhe,3 — hg *hi,3h3,2 = 0, 

hoi3 —hi~'higha1 — h3'h3ihe3 = 0, 

hai — hy thighs = ha ‘her1hs3,2 = 0, 

hzhe,3,3 + h3h3.2,2 + hy *hahgho,1h3,1 = hg thghogh3,2 
— hgh3‘h2,3h3,3 = 0, 
hyhi,3,3 + hgh3ia t+ hihe “hghizhs,2 — hi hghihs, 
—hyh3 ‘hi ghs,3 = 0, 
hyhi2.2 + hehe + hy hgh3*hi3h2,3 = hy Aghi she, 

—hyhg "hy gha2 = 0. 





11. 


12. 
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The 2-sphere: A coordinate system [0, ¢] for the 2-sphere x? + y? + 27 = r? is 
given by x = rsin@cos@, y = rsin@ sind, z = rcos9, where [0, dé] € U = 
(0,7) x (0,27). This is a non-Euclidean space. The non-zero independent 
components of various quantities defined on the sphere are: 


(a) Covariant metric tensor components: gu = r?, g22 = r? sin? 0. 
(b) Contravariant metric tensor components: 
gua, gg? a=r-* wed, 
(c) Christoffel symbols of the first kind: 
[12, 2] = r? sin @ cos 6, [22,1] = —r? sin 6 cos 0. 
(d) Christoffel symbols of the second kind: 
T'1, = —sin@ cos, T45 = —cosOcscd. 
(e) Covariant Riemann tensor components: Rio =r? sin? 6. 
(f) Covariant Ricci tensor components: Ry =-1, Ro =-—sin? 6. 


(g) The Ricci scalar: R = —2r~?. 


The 3-sphere: A coordinate system [w, 0, ¢] for the 3-sphere x? + y? + 2? + 
w? = r? is given by x = rsinysin@cos¢, y = rsinysindsing, z = 
r sin w cos 6, and w = r cos w, where [w, 0, 6] € U = (0,7) x (0, 7) x (0, 277). 
The non-zero components of various quantities defined on the sphere are: 


(a) Covariant metric tensor components: 


gu = r’, 922 = r? sin? a, 933 = r? sin? sin? 6 
(b) Contravariant metric tensor components: 
gi=r, g? =r 7 csc? y, g?? =r? esc? wesc? 0 
(c) Christoffel symbols of the first kind: 
[22,1] = —r? sin cosy (33, 1] = —r? sin cos a sin? 6 
[12, 2] = r? sin cos wp (33, 2] = —r? sin? w sin 6 cos 0 


[13,3] =r?sinycoswsin?@ [23,3] = r? sin? ~ sin @ cos 0. 
(d) Christoffel symbols of the second kind: 


T.. = —siny cosy I'43 = — sina cos sin? 6 
rs cote T’,, = — sin cos0 
T44 = cot? i, = cor. 
(e) Covariant Riemann tensor components: Rigg =r? sin? w, 
Ry4313 = r? sin? wy sin? 6, R323 = r? sin* w sin? 0. 


(f) Covariant Ricci tensor components: 
Ry =-2, Ro =—2sin?, R33 = —2sin? Wsin? 6. 
(g) The Ricci scalar: R = —6r~?. 
(h) Covariant Einstein tensor components: 
Gu =1, Goo = sin? y, G33 = sin? sin? 6 
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5.10 ORTHOGONAL COORDINATE SYSTEMS 


In an orthogonal coordinate system, let {a;} denote the unit vectors in each of the 
three coordinate directions, and let {w;} denote distance along each of these axes. 
The coordinate system may be designated by the metric coefficients {g11, 922, 933}. 


defined by ; . 
_— Or, . Ox2 0x3 


where {21, 22,23} represent rectangular coordinates. With these, we define g = 
911922933- 

Operations for orthogonal coordinate systems are sometimes written in terms of 
{h;} functions, instead of the {g;;} terms. Here, hj = \/Gii, so that \/g = hi hzhs3. 
For example, in cylindrical coordinates, {v; = rcos@, x2 = rsin@, 73 = z}, so 
that {hy 1, he r, hg aye 

In the following, ¢ represents a scalar, and E = Fya, + E2a2 + E3az and 
F = Fa, + Foa2 + Faz represent vectors. 

















grad 6 = Vo = the gradient of ¢ 
ay Oo a2 oo) a3 Od 


= ——+ — + i 
Jou Our \/g22 Our ~—-\/g33 Ous 
div E = V - E = the divergence of E 


12 2) i) (=) 0 (=)} 
= BE) ge (SE OSE gens 
lie (< Ouz \ g22 Ouz \ 933 ‘ 


curlE = V x E = the curl of E 











(5.10.2) 

















ee eee ee (5.10.4) 
‘Vou * 922 * 933 _ 
ay a 
hohs3 hih3 hyhe 

= fd) fa) a 

=|3 go I, (5.10.5) 
h,E, hake h3E3 

[(F - V) E], = the convective operator 
3 
F;, OE; E; Oh; Oh; 
= “| Ft — F—— 5.10.6 
y iF: Dui h hj = ( ” Ou; ale : 


V7¢ = the Laplacian of ¢ (sometimes written as Ad) 


Fs Bos | hr Dor| * Bas | hp Ba|* Bs | ta OJ 








= hyhohs Our hy Our Oug ho Our Ous hg Ou3 
a! O V9 Og ‘eg O v9 Og ioe O VI Og 
_ VG Ou, Jil Ou, Ou g22 Ou du3 933 Ou3 : (5.10.7) 
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ay Oy a2 OY a3 OY 


ee, 86a 
Jou Ot \/922 0X2 G33 0x3 ‘ 


grad div E = V(V -E) = 


curlcurlE = V x (V x E) 


_ 4g, (Bz [as _aR2] , ., ftw flr _ ats 
- Ox 0x3 2 0x3 Ox, (5.10.9) 
= 2 Oly 
= a 2 | Ox : 
ME = grad div E — curl curl E = the vector Laplacian of E 
=V(V-E)-V~x x E) 


= oy {2 yf [ie _ ae) 
ven a a a (5.10.10) 
is 1 OY | fg22/O03 _ V1 

4/922 Ox2 


Ox, 0x3 


va Lot, is ae 
: 4/933 Or3 Ox Oxy : 


where TY and T' = (1,,T2,T3) are defined by 


aloe PE | tom PVA] tom VSI} 
ae i es 
9 {= | : 74 Goo dx3 | °\ 93s 




















V9 gu 
ry = S| WIRED) ~ ge VERE) 
t= a {a (VF) - 5 io vines) } (5.10.11) 
ry = 2 vines) - ° (vines). 


5.10.1. TABLE OF ORTHOGONAL COORDINATE SYSTEMS 


The {f;} listed below are the separated components of the Laplace or Helmholtz 
equations (see (5.7.16) and (5.7.17)). See Moon and Spencer for details. 

The eleven coordinate systems listed below are the only coordinate systems in 
Euclidean space (up to an isometry) for which the Laplace or Helmholtz equation 
may be solved by separation of variables. 

The corresponding equations for the four separable coordinate systems which 
exist in two-dimensions may be obtained from the coordinate systems 1-4 listed 
below by suppressing the z coordinate and assuming that all functions depend only 
on the x and y coordinates. 
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Rectangular coordinates {x, y, z} 

Ranges: -wO<2<W,-CO<KY<KW,-WO<K ZK Ww. 
gu = 922 = 933 = J/g = 1, 

fi = fe= fs =1. 








In this coordinate system the following notation is sometimes used: 


i=a,,j=a,,k=a,. 






































i of of of 
grad f = a2 7 + ya, vee 
0 0 0 
divE = 9, Es) + By Ee) 5 (Ez) 
_ (OE, OE, OE, OF: OE, 
ee ( dy Oz a+ ( dz Ox Jay + (F2- 
2 2 2 
wpa Oh OF OF 
Ox? Oy? Oz? 
OE, OE, OE, 
E|.. = F, —+F, F,— 
V)El. Ox thy Oy 7” Oz 
. Circular cylinder coordinates {r, 6, z} 
Relations: x = rcos0, y=rsind, Z=2z. 
Ranges: 0 <r < w, 0<6< 27, —-0 <z< OO. 
gu = 933 = 1, jn =r, JgI=T; 
ae fo=fs =1. 
O ag O O 
onto th BOL nal 
10 10E, OE. 
CVE = 9p Er) + ag + Bz 
10OE, OE6 
a ae aes 
OE, OE: 
(curlE)g = ay op 
_10(rE9) 108, 
ee a oe oe 
10 (/ Of Loy. oF 
2 = ns — 
vipate (rot) 5 02? 
. Elliptic cylinder coordinates {1, 1), z} 
Relations: x = acosh cos wy, y = asinh 7 sin wy, 


Ranges: 0 < 7 < ov, O0<w< 2a, 
gu = 922 = a?(cosh? 7 — cos? w), 
Vg = 27(cosh” n — cos? *p), 

fi =fe= fs =1. 


—-o <z2< OM. 
933 = 1, 





OF, . 
Oy * 


(5.10.12) 


(5.10.13) 


zZ=2. 
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4. Parabolic cylinder coordinates {j, v, z} 
Relations: x = $(u? — v?), y = pl, 2s 
Ranges: 0 < fu < 00, —o <y< 2n, —0 <z< OH. 
gi =9g2=e+v, g3=1, Vg=wtr’, 
Ai=h= p= 1 
5. Spherical coordinates {7, 0, w} 
Relations: 7 = r sin @ cos ¢, y =rsin@sin d, z=rcosé. 
Ranges: 0 <r < «, 0<0<7, O<w<2rz. 
gu =1, g22 =r’, 933 = r2 sin? 0, Vg =r? sind, 
fi =r, fo =sin8@, fg =1. 
Of eg Of ey Of 
df=e,—+—-— — 
ent ee oe pend ae 
10 1 O 1 OF 
divE = =—(r?E, Eg sin —? 
~ on )+ nd 36‘ — ae Og 
0 OAg 
1E),, = — EF 0 5.10.14 
enle) r sin 0 Ei pony) = — ( 
1 OF, 10(rE 
(curl E) (rE) 











6 rsind Ob 7 Or 
1 O(rEo) 7 10E, 
r Or r 06 








(curlE), = 





Yi= es (eZ) + : = (sino34 ) - ee 


Or r2 sin 6 00 00 r2 sin? 6 0¢2 


6. Prolate spheroidal coordinates {7, 6, «} 


Relations: 7 = asinh 7 sin # cos w, y = asinh 7 sin @ sin wy, 
z = acoshn cos 6. 

Ranges: 0 < 7 < co, 0<0<n7, O<w< 2n. 

git = 922 = a?(sinh? 7 + sin? 6), 933 = a? sinh? n sin” 6, 


Vg = a°(sinh* 7 + sin? 6) sinh 7 sin 0. 
fi = sinh 7, fo =sin8, f3 =a. 


7. Oblate spheroidal coordinates {7, 0, 1} 


Relations: « = acoshnsin 6 cos w, y = acoshn sin @ sin wv, 
z = asinh7 cos 6. 

Ranges: 0 < 7 < on, 0<0<n7, O<w<2n. 

gi = 922 = a?(cosh? n — sin? 6), 933 = a? cosh? n sin? 6, 


Vg = a3 (cosh? 7 — sin? 0) cosh 7) sin 0. 
fi = cosh yn, fo = sin 8, fg =a. 


392 


8. 


10. 


11. 


CHAPTER 5. ANALYSIS 


Parabolic coordinates {j1, v, w} 


Relations: 2 = pv cos, y = pv siny, z=5(w—v?). 
Ranges: 0 < pu < co, 0<Vv<a, O<w<2r. 
911 = gon = Ww? +”, 933 = wv, Jo = p(w? +07). 


fi =p, fo=y, fg =1. 


. Conical coordinates {r, 6, \} 


Relations: x? = (r@X/bc)?, y? = r7(62 — b2)(b? — 7) /[b?(c? — b?)), 
2? = 77 (c? — 67) (c? — A?) /[c? (Cc? — b?)). 

Ranges: 0 <r < ox, P< <c?, 0<)? <b?. 

gi=1, goa =1?(6? — d*)/((6? — b?)(c? — 6?)), 

ga3 = 77(0? — *)/((b? — A*) (ce? — A*)), 

VI = r2 (6? 
hat p= VPTEP) fh VOTER 


Ellipsoidal coordinates {1,0, A} 

Relations: x? = (n0A/bc)?, 

y? = (1? — 0°)? — B°)(b? ALAC * — b?)], 

2 = (1? — c*)(c* — P(e? — d*)/[e?(e? — b*)]. 

Ranges: c? < 7? < 00, rear, Oe <0". 
gu = (1? — Om, = Se - es = me 

G22 = (8 — *)(n? — 6°) /((8? be 6"). 

933 = (1? — (2 - d*)/ (8 — *)(c? — *)), 

i= (2-6) (? 02) (0-22) 


(1? —b?) (7? — c?) (6? —b?) (c? 0?) (b?— A?) (c?—A2) * 
fi=VOr-—b (7? —c*), fa = (0? — *)(c* — 67), 
fa = V(b? — A?) (Cc? — A). 
Paraboloidal coordinates { j., v, } 
Relations: x? = 4(u — b)(b—v)(b — A)/(b—c), 
y? =4(w—c)(c—v)(A—c)/(b—- 0), z=pt+vt+A-—b-e. 
Ranges: b << u< ~, 0<VvK<e c<A<b. 
gu = (w— v)(u— A)/((u — b)(u— €)), 
go2 = (u—v)(A—v)/((b—v)(e—v)), 


gaa = (A —v)(u— A)/((b— A) — ©), 


= (u=V) (MA) (A=) 
v9 (u—b)(H—e)(b—v)(c—v) (b—A)(A=C) | 


=V(u—d)(u-c), fe=Vb-vY(c-v), fa=VO-A)A—C) 
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5.11 REAL ANALYSIS 


5.11.1. RELATIONS 


For two sets A and B, the product A x B is the set of all ordered pairs (a, b) where 
ais in A and bis in B. Any subset of the product A x B is called a relation. A 
relation R ona product A x A is called an equivalence relation if the following three 
properties hold: 


1. Reflexive: (a,a) isin R for every ain A. 
2. Symmetric: If (a,b) is in R, then (b, a) isin R. 
3. Transitive: If (a,b) and (b,c) are in R, then (a,c) isin R. 


When F is an equivalence relation then the equivalence class of an element a in A 
is the set of all b in A such that (a, b) is in R. 


1. If|A] =n, there are 2”” relations on A. 
2. If |A| = n, the number of equivalence relations on A is the Bell number Bn. 


Set Relation Symmetric 
Se 

{1, 2,3} Tit 
(1, 2, 


any nonempty set | no | 
Prealnumbers <0 


EXAMPLE The set of rational numbers has an equivalence relation “=” defined by the 
requirement that an ordered pair (¢, 5) betones in the relation if and only if ad = bc. 
The equivalence class of 4 5 Is the set (1,2 a 2, mae 


real numbers 





3.55,...}. 


5.11.2 FUNCTIONS (MAPPINGS) 


A relation f ona set X x Y is a function (or mapping) from X into Y if (a, y) and 
(a, z) in the relation implies that y = z, and each x € X has ay € Y such that 
(x, y) is in the relation. The last condition means that there is a unique pair in f 
whose first element is 7. We write f(x) = y to mean that (x, y) is in the relation f, 
and emphasize the idea of mapping by the notation f: X — Y. The domain of f is 
the set X. The range of a function f is a set containing all the y for which there is a 
pair (a, y) in the relation. The image of a set A in the domain of a function f is the 
set of yin Y such that y = f(x) for some x in A. The notation for the image of A 
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under f is f[A]. The inverse image of a set B in the range of a function f is the set 
of all z in X such that f(x) = y for some y in B. The notation is f~'[{B]. 

A function f is one-to-one (or univalent, or injective) if f(x1) = f (x2) implies 
“1 = £2. A function f: X — Y is onto (or surjective) if for every y in Y there is 
some x in X such that f(x) = y. A function is bijective if it is both one-to-one and 
onto. 


EXAMPLES 


1. f(x) = e*, as a mapping from R to R, is one-to-one because e*! = e*? implies 
“1 = £2 (by taking the natural logarithm). It is not onto because —1 is not the value of 
e* for any x in R. 

2. g(x) = x? —2, as a mapping from R to R, is onto because every real number is attained 
as a value of g(a), for some «. It is not one-to-one because g(—1) = g(0) = g(1). 

3. h(x) = x3, as a mapping from R to R, is bijective. 








For an injective function f mapping X into Y, there is an inverse function f~! 
mapping the range of f into X which is defined by: f~'(y) = 2 if and only if 
f(x) =y. 


EXAMPLE The function f(z) = e” mapping R into R* (the set of positive reals) is 
bijective. Its inverse is f~+(a) = In(z) which maps R* into R. 


For functions f: X — Y and g: Y — Z, with the range of f contained in the 
domain of g, the composition (go f): X — Z is a function defined by (go f)(x) = 
g(f(«)) for all x in the domain of f. 


1. Note that g o f may not be the same as f 0 g. For example, for f(x) =x +1, 
and g(a) = 2a, we have (go f)(a) = g(f(x)) = 2f (x) = 2(a@4+1) = 2442. 
However (f 0 g)(x) = f(g(x)) = g(a) +1 = 2a +1. 

2. For every function f and its inverse f~', we have (f o f~!)(x) = 2, for all 
x in the domain of f~+, and (f~! o f)(x) = = for all x in the domain of f. 
(Note that the inverse function, f~1, does not mean 3). 





5.11.3. SETS OF REAL NUMBERS 


A sequence is the range of a function having the natural numbers as its domain. It 
can be denoted by {x,, | 2 is anatural number} or simply {x,,}. For a chosen natural 
number JN, a finite sequence is the range of a function having natural numbers less 
than N as its domain. Sets A and B are in a one-to-one correspondence if there is 
a bijective function from A into B. Two sets A and B have the same cardinality if 
there is a one-to-one correspondence between them. A set which is equivalent to the 
set of natural numbers is denumerable (or countably infinite). A set which is empty 
or is equivalent to a finite sequence is finite (or finite countable). 


EXAMPLES The set of letters in the English alphabet is finite. The set of rational num- 
bers is denumerable. The set of real numbers is uncountable. 
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5.11.3.1. Axioms of order 


1. There is a subset P (positive numbers) of R for which x + y and xy are in P 
for every x and y in P. 

2. Exactly one of the following conditions can be satisfied by a number x in R 
(trichotomy): x € P,-—a € P,orx = 0. 


5.11.3.2 Definitions 


A number 0 is an upper (or lower) bound of a subset S in Rif x < b (or x > b) for 
every x in S. A number c is a least upper bound (lub, supremum, or sup) of a subset 
S in Rif cis an upper bound of S' and b > c for every upper bound b of S. A number 
cis a greatest lower bound (glb, infimum, or inf) if cis a lower bound of S and c > b 
for every lower bound 6 of S. 


5.11.3.3 Completeness (or least upper bound) axiom 


If a non-empty set of real numbers has an upper bound, then it has a least upper 
bound. 


5.11.3.4 Characterization of the real numbers 


The set of real numbers is the smallest complete ordered field that contains the ratio- 
nals. Alternatively, the properties of a field, the order properties, and the least upper 
bound axiom characterize the set of real numbers. The least upper bound axiom 
distinguishes the set of real numbers from other ordered fields. 

Archimedean property of R: For every real number «, there is an integer NV such 
that x < N. For every pair of real numbers x and y with x < y, there is a rational 
number r such that x < r < y. This is sometimes stated: The set of rational numbers 
is dense in R. 


5.11.3.5 Inequalities among real numbers 
The expression a > b means that a — b is a positive real number. 
1. Ifa < bandb <cthena <c. 


2. Ifa < bthena +c < b+c for any real number c. 
if c > 0 then ac < bc 














3. Ifa < band, . 
if c < O then ac > bc 


4. Ifa < bandc<dthena+c< bd. 
5. If0 <a < band0 <c< dthenac < bd. 


ab >0 
6. Ifa < band ei then 


ao< 


V 
Sle Sle 


alresalir 
/\ 
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5.11.4 TOPOLOGICAL SPACE 


A topology ona set X is acollection T of subsets of X (called open sets) having the 
following properties: 


1. The empty set and X are in T. 
2. The union of elements in an arbitrary subcollection of T is in T’. 
3. The intersection of elements in a finite subcollection of T is in 7’. 


The complement of an open set is a closed set. A set is compact if every open cover 
has a finite subcover. The set X together with a topology T is a topological space. 


5.11.4.1. Notes 


1. A subset F of X is closed if and only if & contains all its limit points. 
2. The union of finitely many closed sets is closed. 

3. The intersection of an arbitrary collection of closed sets is closed. 

4. The image of a compact set under a continuous function is compact. 


5.11.5 METRIC SPACE 


A metric (or distance function) on a set E is a function p: E' x E — R that satisfies 
the following conditions: 


1. Positive definiteness: p(x,y) > 0 for all x, y in FE, and p(x, y) = Oif and only 
ifx=y. 

2. Symmetry: p(x,y) = ply 

3. Triangle inequality: p(x, 


, x) for all x, y in FE. 
Yy) < p(x, z) + plz, y) for all x, y, z in E. 


EXAMPLE 


The set of real numbers with distance defined by d(x, y) = |a — y| is a metric space. 


A 6 neighborhood of a point x in a metric space F is the set of all y in F’ such that 
d(x,y) < 6. For example, a 6 neighborhood of x in R is the interval centered at «x 
with radius 6, (x — 6,2 + 6). In a metric space the topology is generated by the 6 
neighborhoods. 


1. A subset G of R is open if, for every x in G, there is a 6 neighborhood of x 
which is a subset of G. For example, intervals (a,b), (a,oo), (—oo,b) are open 
inR. 

2. A number z is a limit point (or a point of closure, or an accumulation point) 
of a set F' if, for every 6 > 0, there is a point y in F’, with y # x, such that 
ja—y| <0. 

3. A subset F’ of R is closed if it contains all of its limit points. For example, 
intervals [a, b], (—oo, b], and [a, 00) are closed in R. 

4. A subset F is dense in R if every element of R is a limit point of F’. 
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5. A metric space is separable if it contains a denumerable dense set. For ex- 
ample, R is separable because the subset of rationals is a denumerable dense 
set. 

6. Theorems: 


Bolzano-Weierstrass theorem Any bounded infinite set of 
real numbers has a limit point in R. 


Heine—Borel theorem A subset of R is compact if and only if it 
is closed and bounded. 


5.11.6 CONVERGENCE IN R WITH METRIC |z — y| 
5.11.6.1 Limit of a sequence 


A number L is a limit point of a sequence {x,, } if, for every « > 0, there is a natural 
number N such that |x, — L| < € forall n > N. If it exists, a limit of a sequence 
is unique. A sequence is said to converge if it has a limit. A number L is a cluster 
point of a sequence {x,,} if, for every « > 0 and every index N, there is ann > N 
such that |x, — L| < e. 


EXAMPLE The limit of a sequence is a cluster point, as in {+}, which converges to 0. 
However, cluster points are not necessarily limits, as in {(—1)”}, which has cluster 
points +1 and —1 but no limit. 

Let {2} be a sequence. A number L is the limit superior (limsup) if, for every 
€ > O, there is a natural number N such that x, > L — ¢€ for infinitely many n > JN, 
and x, > L + e for only finitely many terms. An equivalent definition of the limit 
superior is given by 

lim sup #7, = inf sup rz. (5.11.1) 
N K>N 


The limit inferior (liminf) is defined in a similar way by 
liminf x, = inf xp. 11.2 
iminf x aup ay De (5 ) 
For example, the sequence {x,,} with z, = 1+ (—1)"+ + has limsupz, = 2, 
and lim inf x, = 0. 


Theorem Every bounded sequence {z,,} in R has a lim sup and 
a liminf. In addition, if limsupz, = liminfz,, then the sequence 
converges to their common value. 


A sequence {x,,} is a Cauchy sequence if, for any « > 0, there exists a positive 
integer N such that |x, — %| < €foreveryn > N andm > N. 


Theorem A sequence {,,} in R converges if and only if it is a 
Cauchy sequence. 


A metric space in which every Cauchy sequence converges to a point in the space is 
called complete. For example, R with the metric d(x, y) = |a — y| is complete. 
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5.11.6.2 Limit of a function 


A number L is a /imit of a function f as x approaches a number a if, for every € > 0, 
there is a 6 > 0 such that | f(z) — L| < ¢ for all x with 0 < |x — a| < 6. This 
is represented by the notation lim,_,, f(a) = L. The symbol co is the limit of a 
function f as x approaches a number a if, for every positive number lM, there is 
ad > 0 such that f(x) > M for all x with 0 < |x —a| < 6. The notation is 
lim, f(a) = oo. A number L is a limit of a function f as x approaches oo if, for 
every € > 0, there is a positive number M/ such that | f(a) — L| < €foralla > M; 
this is written lim,_,.. f(x) = L. The number L is said to be the limit at infinity. 
EXAMPLES lim3r—1=5, lim—>=co, lim ==0. 


x20 x2 Zoo D 


5.11.6.3 Limit of a sequence of functions 


A sequence of functions { f;,(”)} is said to converge pointwise to the function f («) 
on a set # if for every « > 0 and x € E there is a positive integer N such that 
| f(a) — fn(x)| < € for every n > N. A sequence of functions {f,,(2)} is said to 
converge uniformly to the function f ona set EF if, for every « > 0, there exists a 
positive integer NV such that | f(x) — fn(x)| < € forall xin BE andn > N. 

Note that these formulations of convergence are not equivalent. For example, 
the functions f,,(”) = x” on the interval [0, 1] converge pointwise to the function 
f(x) = Ofor0 < « < 1, f(1) = 1. They do not converge uniformly because, for 
€ = 1/2, there is no N such that | f,(a) — f(a)| < 1/2 for all x in [0, 1] and every 
n>N. 

A function f is Lipschitz if there exists k > 0 in R such that | f(a) — f(y)| < 
k|a — y| for all x and y in its domain. The function is a contraction if 0 < k < 1. 


Fixed point or contraction mapping theorem Let E be a 
complete metric space. If the function f: EK — F is a contraction, then 
there is a unique point x in F such that f(a) = x. The point z is called 
a fixed point of f. 


EXAMPLE  Newton’s method for finding a zero of f(a) = (2 + 1)? — 2 on the interval 
[0, 1] produces %n41 = g(n) with the contraction g(x) = $ — $+ =a This has 


the unique fixed point /2 — 1 in [0, 1]. 


5.11.7 CONTINUITY IN R WITH METRIC |a — y| 


A function f: R — R is continuous at a point a if f is defined at a and 
limy-+a f(x) = f(a). The function f is continuous on a set E if it is continu- 
ous at every point of F. A function f is uniformly continuous on a set E if, for every 
€ > O, there exists a d > 0 such that | f(a) — f(y)| < € for every x and y in E with 
|x — y| < 6. A sequence {f,,(x)} of continuous functions on the interval [a, b] is 
equicontinuous if, for every € > 0, there exists ad > 0 such that | f,,(”) — fn(y)| < € 
for every n and for all x and y in [a, b] with |x — y| < 6. 
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1. A function can be continuous without being uniformly continuous. For exam- 
ple, the function g(x) = + is continuous but not uniformly continuous on the 
open interval (0, 1). 

2. Acollection of continuous functions can be bounded on a closed interval with- 
out having a uniformly convergent sub-sequence. For example, the continuous 


functions f,(x) = z are each bounded by 1 in the closed inter- 


ae 
x?2+(1—nz) 
val [0,1] and for every « there is the limit: limps. fn(z) = 0. However, 
fn (+) = | for every n, so that no sub-sequence can converge uniformly to 0 
everywhere on [0, 1]. This sequence is not equicontinuous. 


3. Theorems: 


Theorem Let { f;,(a)} be a sequence of functions mapping R into 
R which converges uniformly to a function f. If each f,,(a) is continu- 
ous at a point a, then f (2) is also continuous at a. 


Theorem If a function f is continuous on a closed bounded set FE, 
then it is uniformly continuous on EF. 


Ascoli-Arzela theorem Let K be a compact set in R. If 
{ fn(x)} is uniformly bounded and equicontinuous on K, then { f,(x)} 
contains a uniformly convergent sub-sequence on Kx. 


Weierstrass polynomial approximation theorem Let K be 
a compact set in R. If f is a continuous function on K, then there exists 
a sequence of polynomials that converges uniformly to f on Kk. 


5.11.8 BANACH SPACE 


A norm on a vector space FE with scalar field R is a function || - || from £ into R that 
satisfies the following conditions: 








1. Positive definiteness: \|x|| > 0 for all x in E, and ||2|| = 0 if and only if 
x=0. 

2. Scalar homogeneity: For every x in E anda in R, ||az|| = |a| ||a|]. 

3. Triangle inequality: ||x + y|| < ||x|| + |ly|| for all a, y in E. 
Every norm || - || gives rise to a metric p by defining: p(x, y) = ||x — y]|. 
EXAMPLES 

1. R with absolute value as the norm has the metric p(x, y) = |x — y|. 

2. IR x R (denoted R?) with the Euclidean norm ||(«, y)|| = \/z? + y?, has the metric 











p((#1, 41), (%2, y2)) = (x1 x2)? (y1 y2)?. 


A Banach space is a complete normed space. 

A widely studied example of a Banach space is the (vector) space of measurable 
functions f on [a, b] for which i | f(a)|? dx < co with 1 < p < oo. This is denoted 
by L?{a, b] or simply L”. The space of essentially bounded measurable functions on 
(a, b] is denoted by L°{a, b}. 
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1/p 
The L? norm for 1 < p < o is defined by ||f||,, = 0 | f(a)|? dr) . The 
L° norm is defined by 


fll =ess sup |f(x)], G-IL3) 
a<a<b 
where 
ess sup |f(a)| =inf{M|m{t: f(t) > M} = 0}. (5.11.4) 
a<a<b 


Let { f,(a)} be a sequence of functions in L? (with 1 < p < oo) and f be some 
function in L?. We say that {f,,} converges in the mean of order p (or simply in 
L?-norm) to f if limp—+co || fn — fll, = 0. 


Riesz—Fischer theorem The L? spaces are complete. 


5.11.8.1 Inequalities 


1. Arithmetic mean—geometric mean inequality If A, and G,, are the arith- 
metic and geometric means of the set of positive numbers {a1, a2,...,@n} 
then A,, > Gy. That is 


a, +adg+...+dn 
n 


> (a1ag+++ an)” 


2. Carleman’s inequality If A, and G’, are the arithmetic and geometric means 


of the set of positive numbers {a1, a2,...,@,} then 
n 
G, <neA,, 
r=1 


3. Holder inequality If p and q are non-negative extended real numbers such 
that 1/p + 1/q = 1and f € L? andg € L’, then ||fgl|, < |If\l, llgllq: 


b b 1/p b 1/q 
fvis(f ur (/ sr) forl<p<oo, (5.11.5) 


and (taking the limit as q - 1 and p —> 0) 


b b 
J lta) (esssun itt) [I 6.11.6) 


4. Jensen inequality A continuous function f on [a,b] is called convex if the 
Jensen inequality holds 


F (2 tn) : ee) (5.11.7) 


for all x1 and x2 in [a, b]. 
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5. Minkowski inequality If f and g are in L? with 1 < p < o, then 
lf +gllp < Fl, + Ilgll,: 


b 1/p b 1/p i 1/p 
(/ +0") <(f ur) +(f 0") Pneie: 


(5.11.8) 
ess sup |f + | < esssup |f] + esssup |g]. 


6. Schwartz (or Cauchy-Schwartz) inequality If f and g are in L?, then 
fall, < Wlflle llgll,- This is the special case of Hélder’s inequality with 
p=q=2. 


5.11.9 HILBERT SPACE 


An inner product on a vector space F with scalar field C (complex numbers) is a 
function from EF x FE into C that satisfies the following conditions: 





1. (a,x) > 0, and (a,x) = 0 if and only if 2 = 0. 
2. (x+y, 2) = (x, 2) + (y, 2) 
3 (cx, y) are c (x,y) 
4. (x,y) = (y, 2) 
Every inner product (a, y) gives rise to anorm ||x|| by defining |||] = (2, a)? 


A Hilbert space is a complete inner product space. A widely studied Hilbert 
space is L?[a, b] with the inner product (f,g) = iL f(t)g(t) dt. 
Two functions f and g in L?{a,b] are orthogonal if i. fg = 0. A set of L? 


functions {¢,,} is orthogonal if iB dmon = 0 form #n. The set is orthonormal 
if, in addition, each member has norm 1. That is, ||¢,||, = 1. For example, the 
functions {sin nx} are mutually orthogonal on (—7, 7). The functions {eS form 
an orthonormal set on (—7, 7). 

Let {¢,} be an orthonormal set in L? and f be in L?. The numbers cp, = 
iM fon dx are the generalized Fourier coefficients of f with respect to {@,,}, and the 
series )7), Cngn(x) is called the generalized Fourier series of f with respect to 
{on}. 

For a function f in L?, the mean square error of approximating f by the sum 

, b N ; 

= 4 Ondn is po J f(x) — =i AnGn(x)|? dx. An orthonormal set {¢,,} is 
complete if the only measurable function f that is orthogonal to every ¢,, is zero. 
That is, f = 0 a.e. (In the context of elementary measure theory, two measurable 
functions f and g are equivalent if they are equal except on a set of measure zero. 
They are said to be equal almost everywhere. This is denoted by f = g a.e.) 

Bessel’s inequality: For a function f in L? having generalized Fourier coeffi- 


cients {en}, 55, 1 |e? | S He [f (a)? de. 
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. Riesz—Fischer theorem Let {@,,} be an orthonormal set in L? and let 


{Cn} be constants such that )>>~_, |c?| converges. Then a unique function f 
in L? exists such that the c,, are the Fourier coefficients of f with respect to 
{bn} and S~"°_, Cnn converges in the mean (or order 2) to f. 


. Theorem The generalized Fourier series of f in L? converges in the 
So f=) 


mean (of order 2) to f. 


. Theorem Parseval’s identity holds: [ |f(z)|? dx = > lee 


. Theorem The mean square error of approximating f by the series 


yr @ngn is minimum when all coefficients a, are the Fourier coefficients 
of f with respect to {dp }. 


EXAMPLE _ Suppose that the series 42 + S7°°_\(\an|? + |bn|?) converges. Then the 


aime series <2 + 4 (dn, cos nx + ie sin nz) is the Fourier series of some 
function in L?. 


5.11.10 ASYMPTOTIC RELATIONSHIPS 


Asymptotic relationships are indicated by the symbols O, 2, 0, 0, and ~. 


1. 


The symbol O (pronounced “big-oh”): f(a) € O(g(a)) as « > apo if a pos- 
itive constant C' exists such that | f(a)| < C |g(x)| for all « sufficiently close 
to %o. Note that O(g(x)) is a class of functions. Sometimes the statement 
f(x) € O(g(«)) is written (imprecisely) as f = O(g). 


. The symbol 2 : f(a) € Q(g(x)) as x > ao if a positive constant C’ exists 


such that |g(2)| < C'| f(a)| for all x sufficiently close to xo. 


. The symbol © : f(x) € O(g(x)) as x > 2p if positive constants c, and co 


exist such that c1g(a) < f(a) < cog(x) for all x sufficiently close to v9. This 
is equivalent to: f(x) = O(g(a)) and g(x) = O(f(a)). The symbol ~ is 
often used for O (i.e., f(a) & g(x)). 


. The symbol o (pronounced “‘little-oh”): f(x) € o(g(a)) as 7 + Zo if, given 


any ps > 0, we have | f(a)| < |g(x)| for all x sufficiently close to xo. 


. The symbol ~ (pronounced “asymptotic to”): f(a) ~ (g(x)) as a > Xo if 


f(x) = g(x) [1+ o(1)] as x > a. 


. Two functions, f(a) and g(a), are asymptotically equivalent as x — Xo if 


f(x)/g(a) ~ lasa > ap. 


. A sequence of functions, {g,(x)}, forms an asymptotic series at xo if 


Ge+1(2) = 0(gx(x)) as x > Zo. 


. Given a function f(a) and an asymptotic series {g;,(a)} at vo, the formal 


series ar apgr(x), where the {a;} are given constants, is an asymptotic 
expansion of f(x) if f(x)— 7-9 Gk gn (x) = 0(Gn(x)) as 7 > ao for every n; 
this is expressed as f(x) ~ )>7°.9 axgn(a). Partial sums of this formal series 
are called asymptotic approximations to f(x). This formal series need not 
converge. 
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Think of O being an upper bound on a function, 2 being a lower bound, and O 
being both an upper and lower bound. For example: sinx € O(x) as xz > 0, logn € 
o(n) asn — oo, and n® € O(n® +n?) as n > oo. 

The statements: n? = o(n°), n° = 0(2”), 2” = o(n!), and n! = o(n”) as 
n — oo can be illustrated as follows. If a computer can perform 10° operations 
per second, and a procedure takes f(n) operations, then the following table indicates 
approximately how long it will take a computer to perform the procedure, for various 
functions and values of n. 


107" sec 10~" sec 107° sec 10~° sec 10~* sec 
1074 sec 10-3 sec 0.3 sec 10 sec 41 minutes 
10~° sec 10-3 sec 2weeks 10!' centuries 10%? centuries 


10!°° centuries 10°°° centuries 


10724 


10-3 sec 77 years 10° centuries 


centuries centuries 


10sec 10” centuries 10°° centuries 101°? 





5.12 GENERALIZED FUNCTIONS 


5.12.1| DELTA FUNCTION 
0 «#0 


oOo 6%= 


Dirac’s delta function is a distribution defined by 0(x) = , and is nor- 


malized so that A ee (a) dx = 1. Properties include (assuming that f(a) is contin- 
uous): 


1. [Hose 6(x — a) de = f(a) 


2 fp ar = (yn 0 








dx™ dx™ 


3. «0(x), as a distribution, equals zero. 


4. d(ax) = ile) when a 4 0 
a 
Cet ee Ce eee 
2a 
1 . : 
6. 0(a) ma as oe (Fourier series) 


7. (a -—€)= > sin - sin — forO<€< L (Fourier sine series) 


2 
L 
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8. O(a) = 7 / e*® dk (Fourier transform) 
T J—oo 
9. 5(p— p') =p f bbn(kp)J( hp") dh 
0 


Sequences of functions {¢,,} that approximate the delta function as n — oo are 
known as delta sequences. 


EXAMPLES 
1 
(a) ¢n(x) = =, 7 _fo |x| >1/n 
09 da) = ae OOS | a tol <a 
n(x) = —=e 

Va 

1 sin? nex 
(c) bn(x) = a 


The delta function 5(x — x’) = 6(x; — x/,)d(w2 — #4)d(a3 — 4) in terms of the 
coordinates (£1, 2, €3), related to (x1, v2, x3), via the Jacobian J(x;,€;), is written 
1 
| F(x, €3)| 


For example, in spherical polar coordinates 


6(x—x’) = O(E1 — €1)6(€a — €5)6(E3 — &3). (5.12.1) 


d(x —x’) = =4(r — r’)d(¢ — ¢')d(cos 6 — cos 6’). (5.12.2) 


The solutions to differential equations involving delta functions are called 
Green’s functions (see pages 358 and 365). 


5.12.2 OTHER GENERALIZED FUNCTIONS 


The Heaviside function, or step function, is defined as 





. 0 «<0 
A(x) = d(t) dt = 5.12.3 
) [. 0 ‘ x > 0. ‘ 
Sometimes H (0) is stated to be 1/2. This function has the representations: 
1 ee “1 _ nnx 
1 H(z)=5+— ) 7 sin (when |x| < L) 
n=odd 
ee hae a os i : 
2. H(x) = aa E dk (this is a principal-value integral) 
Tt Jog 


The related signum function gives the sign of its argument: 


-1 ifz<0 
sgn(x) =2H (x) -—1= , ce (5.12.4) 
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5.13 COMPLEX ANALYSIS 


5.13.1. DEFINITIONS 


A complex number z has the form z = x + zy where x and y are real numbers, and 
i = \/—1; the number i is sometimes called the imaginary unit. We write x = Re z 
and y = Im z. The number z is called the real part of z and y is called the imaginary 
part of z. This form is also called the Cartesian form of the complex number. 
Complex numbers can also be written in polar form, z = re’’, where r, called 


the modulus, is given by r = |z| = \/x? + y?, and @ is called the argument: 0 = 
aree = tan" 4 (when x > 0). The geometric relationship between Cartesian and 
polar forms is shown below 


i) 


z=x+tiy=rel 





The complex conjugate of z, denoted Z, is defined as = x — iy = re~*®. Note 
that |z| = |Z|, argz = —argz, and |z| = V2zz. In addition, 7 = z, 2] +29 = 
21 +Z2, and 2122 = 2122. 





5.13.2 OPERATIONS ON COMPLEX NUMBERS 


1. Addition and subtraction: 

















24, 2g >= (a1 “ iy1) =e (x2 + iy2) = (x4 aE x2) { i(yt =e Yy2). 


2. Multiplication: 


2122 = (1 + tyr) (wo + tye) = (vive — yry2) + i(arye + tayi) = rirget%), 
|z122| = |z1||Zal, arg(z122) = arg 21 + arg z2 = 0, + Oo. 
3. Division: 





2 2122 (tito +yry2) +i(xay1 — Viye2) — 11 oi(1—82) 
Bo z 2 ape oe : 
Z9 2922 w5 + Y5 T92 








21 |21| . [41 : 
—|= —, arg | — ) = arg 2 — arg z2 = 0; — 0. 
22 |z9| ry) 
4. Powers: 
z? = pre? — f(cogsné + isinné) (DeMoivre’s Theorem). 
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5. Roots: z!/" = rl/net(O+2km)/n = pl/™ ( 69 


? 


O+2kr7 |. 7 
s ———— + isin ———— 
n n 


fork = 0,1,...,n—1. The principal root has —1t < 6 < m7 andk = 0. 


5.13.3 FUNCTIONS OF A COMPLEX VARIABLE 


A complex function 
w= f(z) = u(x, y) + iv(w,y) = |wle®, 


where z = x + iy, associates one or more values of the complex dependent variable 
w with each value of the complex independent variable z for those values of z in a 
given domain. 

A function f(z) is said to be analytic (or holomorphic) at a point zo if f(z) is 
defined in each point z of a disc with positive radius R around Zo, h is any complex 
number with |h| < R, and the limit of [f(zo+h)—f(zo)|/h exists and is independent 
of the mode in which h tends to zero. This limiting value is the derivative of f(z) 
at zo denoted by f’(zo). A function is called analytic in a connected domain if it is 
analytic at every point in that domain. 

A function is called entire if it is analytic in C. 

Liouville’s theorem: A bounded entire function is constant. 


EXAMPLES 


1. f(z) = z” is analytic everywhere when n is a non-negative integer. If n is a negative 
integer, then f(z) is analytic except at the origin. 

2. f(z) = Z is nowhere analytic. 

3. f(z) = e* is analytic everywhere. 


5.13.4 CAUCHY-RIEMANN EQUATIONS 


A necessary and sufficient condition for f(z) = u(x, y) + iv(a, y) to be analytic is 
that it satisfies the Cauchy—Riemann equations: 


Ou Ov Ou Ov 
es, i ea 434 
Ox Oy’ a Oy Ox er) 


1. If these equations are satisfied, then both u and v are harmonic functions. That 
is, they satisfy V2u = Uga + Uyy = 0 and V7u = Upz + Vyy = 0. 


2. The Cauchy—Riemann equations can be written as a O for z= x 4+ ty. 
Zz 


5.13.5 DERIVATIVES INCOMPLEX COORDINATES 
If z= a2 + iy then dz = dx + idy, dz = dx — idy, and the derivatives are 


0 1/0 .0 0 1/0. .d 
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Using these, the differential of a complex valued function f(z) is 























Of (z) OF) ae 
a dz 13. 
df De + (5.13.3) 
The derivatives of the conjugate function f(z) satisfy 
Of _ (Af(z) Of _ (Of(z) 
aa ( a5 = ae (5.13.4) 
In multiple dimensions 
_ Of@) , , OFZ) 
df = at dz+ aa dz (5.13.5) 
aoe NS: oe ee) 
Oz 10%’ Oz Oz «| 02,' GF, | 
EXAMPLES 
1. Note the following 
I-59 —z=0 22 2 zag 
Zz Zz Oz Oz (5.13.6) 
Az oxP (-|z|?) = — exp (—2Z) = —Zexp —|z|?) 
2. If f(z) =z" Az then 
OF (2) _ yt Of@) _ wy 
Ou Oz" (5.13.7) 
Of (z) = Az Of (z) a aA 
OZ Oz 


5.13.6 TAYLOR SERIES EXPANSIONS 


If f(z) is analytic inside of and on a circle C' of radius r centered at the point zo, 
then a unique and uniformly convergent series expansion exists in powers of (z— 20) 


z)= S> an(z — z0)”, lz—zl<r, 240, (5.13.8) 
where i i fe) 
Gn ait (zo) Sa [ (z= a)" dz. (5.13.9) 


If M(r) is an upper bound of | f(z)| on C, then 


utr) 


1 
lan] = S| Ff (z0)| < + — (Cauchy’s inequality). (5.13.10) 
nT: 


If the series is truncated with the term a,,(z — zo)”, the remainder R,,(z) is given by 
(z— z0)"t* :) f(s) 
Re 22 a ge 5.13.11 
(2) Qri c (s — z)(s — z0)tt = ( ) 
and 


lz = 20] “t) ey (19.12) 


r—|z— zo] 
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5.13.7 LAURENT SERIES EXPANSIONS 


If f(z) is analytic inside the annulus between the concentric circles C, and C2 cen- 
tered at zo with radii r; and r2 (r1 < 12), respectively, then a unique series expansion 
exists in terms of positive and negative powers of z — zo of the following form: 


f(z) = br(z— 20)>" + YS an(z — 20)” 
> 7 18:19 
= be by 5 
=e + = + —— 49 + a1 (2 — 2%) +: ao(z — 2) +... 





(z—20)% 2-20 
with (here C is a contour between C; and C2) 


1 fs), 


Ses —_— = 0, 1,2.4%. 
Oni Ig (8—m)P 


an 


1 (5.13.14) 
bj; = = / fis\(s—z)"1ds, n=1,2,3,... 
271 Jo 
Equation (5.13.13) is often written in the form 
f(iz)= So Cn(z — 20)” for ry < |z— 20| < re 
N= (5.13.15) 
1 
with Cn = a a ee ee 














~ Ont Jo (2 — 29)"41 


5.13.8 ZEROS AND SINGULARITIES 


The points z for which f(z) = 0 are called zeros of f(z). A function f(z) which is 
analytic at zo has a zero of order m there, where m is a positive integer, if and only 
if the first m coefficients ao, @1,...,@m—1 in the Taylor expansion at zo vanish. 

A singular point or singularity of the function f(z) is any point at which f(z) 
is not analytic. An isolated singularity of f(z) at zo may be classified as one of: 


1. A removable singularity if and only if all coefficients b,, in the Laurent series 
expansion of f(z) at zo vanish. This implies that f(z) can be analytically 
extended to zo. 

2. A pole is of order m if and only if (z — zo) f (z), but not (z — z9)™~1! f(z), 
is analytic at zo, (i.e., if and only if b,, 4 0 and 0 = bm41 = bmig =... in 
the Laurent series expansion of f(z) at zo). Equivalently, f(z) has a pole of 
order m if 1/ f(z) is analytic at zo and has a zero of order m there. 

3. An isolated essential singularity if and only if the Laurent series expansion of 
f(z) at zo has an infinite number of terms involving negative powers of z— zo. 








If not isolated, then a point may be a branch point. These are usually the result of 
a multi-valued function (e.g., \/z or log z). A function can be made single valued 
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within a domain by introducing a cut (a line or curve) which allows discontinuous 
values of the function on opposite sides of the cut. 


Riemann removable singularity theorem: Suppose that a function f is ana- 
lytic and bounded in some deleted neighborhood 0 < |z — zo| < € of a point zo. If f 
is not analytic at zo, then it has a removable singularity there. 


Casorati-Weierstrass theorem: Suppose that zo is an essential singularity of 
a function f, and let w be an arbitrary complex number. Then, for any « > 0, the 
inequality | f(z) — w| < € is satisfied at some point z in each deleted neighborhood 
0< |z — Z| <6 of z. 


5.13.9 RESIDUES 


Given a point zo where f(z) is either analytic or has an isolated singularity, the 
residue of f(z) is the coefficient of (z — zo) in the Laurent series expansion of 
f(z) at 2, or 


Res(zo) = b1 = mm | fee (5.13.16) 


If f(z) is either analytic or has a removable singularity at zo, then b, = 0 there. If 
zo is a pole of order m, then 


1 d™- 1 


b= Gaal qamaal? — 20)" F@)] aces 





z2=Z0 


For every simple closed contour C enclosing at most a finite number of singularities 


21, 22,---, Zn of an function analytic in a neighborhood of C, 
| f(z)dz =2ni S © Res(zx), (5.13.18) 
Cc k=1 


where Res(z;,) is the residue of f(z) at zx. 


5.13.10 THE ARGUMENT PRINCIPLE 


Let f(z) be analytic on a simple closed curve C’ with no zeros on C and analytic 
everywhere inside C' except possibly at a finite number of poles. Let Ac arg f(z) 
denote the change in the argument of f(z) (that is, final value — initial value) as z 
transverses the curve once in the positive sense. Then 





=—Ac arg f(z J=s foe Pe N=P (5.13.19) 


where NV is number of zeros of f(z) inside C, and P is the number of poles inside C. 
The zeros and poles are counted according to their multiplicities. 
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5.13.11 CAUCHY INTEGRAL THEOREM AND FORMULA 


Cauchy integral theorem 
If f(z) is analytic at all points within and on a simple closed curve C, then 


/ f(z)dz=0. (5.13.20) 
Cc 


Cauchy integral formula 
If f(z) is analytic inside and on a simple closed contour C and if 2 is interior 





to C, then 
1 
f(20) = 5 L@ gy, (5.13.21) 
mi Jo %— 20 
Moreover, since the derivatives f’(zo), f” (zo), ... of all orders exist, then 
! 
(n) eel F(z) Fi 13.22 
pro) mf (z — z)?+1 ms (5.13.22) 


5.13.12 TRANSFORMATIONS AND MAPPINGS 


A function w = f(z) = u(z) + iv(z) maps points of the z-plane into corresponding 
points of the w-plane. At every point z such that f(z) is analytic and f’(z) 4 0, 
the mapping is conformal, i.e., the angle between two curves in the z-plane through 
such a point is equal in magnitude and sense to the angle between the corresponding 
curves in the w-plane. A table giving real and imaginary parts, zeros, and singu- 
larities for frequently used functions of a complex variable and a table illustrating a 
number of special transformations of interest are at the end of this section. 

A function is said to be simple in a domain D if it is analytic in D and assumes 
no value more than once in D. 


Riemann’s mapping theorem: If D is a simply connected domain in the com- 
plex z plane, which is neither the z plane nor the extended z plane, then there is a 
simple function f(z) such that w = f(z) maps D onto the disc |w| < 1. 


5.13.12.1 Bilinear transformations 


The bilinear transformation (also called a linear fractional transformation) is defined 


b 
by w = a - 7 where a, b, c, and d are complex numbers and ad # bc. The bilinear 
Cz 


transformation is defined for all z 4 —d/c. The bilinear transformation is conformal 
and maps circles and lines onto circles and lines. 


. ae —dw+b 4... a 
The inverse transformation is given by z = —————, which is also a bilinear 
cw—a 





transformation. Note that w 4 a/c. 


1. The cross-ratio of four distinct complex numbers z;, (for k = 1,2,3,4) is 
given by 
(z1 — 22) (23 — 24) 


(21, 22, 23, 24) = (21 = za) (23 _ z2) ; 
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If any of the z;’s is complex infinity, the cross-ratio is redefined so that the 
quotient of the two terms on the right containing z, is equal to 1. Un- 
der the bilinear transformation, the cross-ratio of four points is invariant: 
(wi, We, W3, Wa) = (21, 22, 23, 24). 

2. Composition of bilinear transformation is equivalent to multiplying matrices. 


az 


Consider the bilinear transformations f(q,»,c,a)(z) = “£3 and 


cz+ 
f(a,B,c,D)(2z) = aa The composition of these is 














— ASH +B (Aa+ Bo)z + (Ab + Bd) 
~ 092th 4D (Ca+ Dc)z+(Cb+ Dad) 


cz+d 


(f(a,b,c,a) ° f(A,B,C,D)) 

















which is another bilinear transformation. Equivalently, note the matrix product 


a b| {A B|]_ |Aa+ Be Ab+ Bd 
c d||C D| |Ca+Dce Cb+Dd 








3. The Mobius transformation is a special case of the bilinear transformation; it 
is defined by w(z) = =| where a is a complex constant of modulus less 
than 1. It maps the unit disk onto itself. 


5.13.12.2 Table of conformal mappings 


In the following functions z = x + iy and w = u+ iv = pe’®. 











1, w=Zz 
2. w = 27. 
w = 27; A’, B’ on the 
3. Qk? 
arabola p = ————_. 
P . 1+cos@ 
” i 
z 
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1 
5. w=. 
z 
6. =e*. 
7. =e. 
8. = e%, 
9. = sin z. 
D C B E Dic B A 
y 
w=sin z. 





w =sinz; BCD: y =k, B'C'D' 
is on the ellipse 


¥ u 2 v 2 1 
z 4 D&E Fl) a 8 (san) + (sane) = 





ED: 
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1—z 
itz 





zZ-a 1+ 2,22 + VJ (1 — a7)(1 — x3) 
Giga 


az—1’ £1 +22 
1—ayrq + /(1— 27)(1 — 23) 








Ro = 
Ll £2 
(a > 1and Ro > 1 when —1 < x2 < x < 1). 


y WY 














Ae 
] u 
z-a l+ajr2+/(a7-1 
= 5 = 
az—1 t+ 22 
x1xq —1 (x? — 1)(a3 — 1) 


Ro = 
y= LD 
(tg <a <x, and0 < Ro < 1 whenl < 22 < 21). 
y ; 


v 





413 
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w = z+1/z; B'C'D' is on the 
ellipse 


ku \? kv \? 
eat ea = 











1 
; ABC is on the 
z+1 


circle x? + y? — 2ycotk =1. 





w = log 














1 
os i ; relationship 





w = log 
z ae 

between centers and radii: centers 

of circles at z, = cothc,,, radii are 


ceschcn,n = 1,2. 














w = klog <2 + log2(1—k) + 
in—klog(z+1)—(1—&) log(z—1); 
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29. 





























z 
= coth (=). 
w = coth (5 
w = logcoth (5). 


w=mTmi+z-—logz. 


[(2? — 1)1/? + cosh™* z]. 


2z—k—-1 
= cosh ! ( ——"_— } — 
W cos hai 
1  |_4[(k+1)z-2k 
= aeah Ae ee 
ko | (k—-Nz 
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5.13.12.3 Table of transformations 


co = 7‘9 =z 3 sjutod yourrg 
CeCe TE O= 9) 

2u(Z/T + 4) = 2 (T = UX) sajog 
Oo = Z Je Aque[nsuls jenuossy 


CCE TF ‘0 = %) 


u(Z/T + ¥) = 2 1 (T = W) sojog 
z ye Aylrepnsurs [enusssy 

















z ye Ale[Nsuls Penuessy 
z ye AYLIE[NSUIs PeNUASSy 
z ye AULIE[NSUIs ;eNUASsy 
z ye AULIE[NSUIs eNUASsy 
z ye Aylrepnsurs [enusssy 


= ut) jutod yoursg 
= uw.) quod yoursg 


z ye (T = w) aJ0g 
ze (Z = UW) a]0d 


zye (T = uw) IJ0g 


ze (Z = UL) VJog 
z ye (T = W) a10d 











ea 








mare 





re 








S| 


























fz soo + xz Yysoo 
fiz urs 


Az ysoo + xZ Soo 
fz quis 


fA.uls x yuts 
furs x ysoo 
A quis x UIs — 


A yuls x Soo 


fiuts a 


z 
(,f + -@) 80] 


fizsoo + xZ% ysoo 
xz yurs 


Az Ysoo + xz soo 
rz us 


fi soo x Ysoo 
fi soo x yUuIsS 
fi ysoo & SOO 


fi. ysoo x uls 
fi soo ,.a 


G 
zit 2@ 


pact|% 


SS] R AMT 
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5.14 SIGNIFICANT MATHEMATICAL EQUATIONS 


Equations that contain profound information 


1. Understanding of zero 


2. Cardinality of the continuum — understanding of infinities 


bo 

‘| 2 
V 
ya 
ra) 


3. Euler’s formula — connection between mathematical constants e™=-1 
4. Quadratic Reciprocity Theorem — connection between primes 





Equations that describe the world 


1. Einstein equation — understanding time and space 


1 87G 
Ry _ 5 Iu k =F Suv = — lw 


a4 


2. Euler’s polyhedron formula — understanding polyhedra geometry 


X=V-E+F 
3. Gibbs equation — understanding thermodynamics AG = AH —-TAS 


4. Maxwell’s equations — understanding electromagnetism 


OE 
VxB= — 
x Lod + Lo€o DE 





5. Navier-Stokes equations — understanding fluids 
O 
(F +y- Vy) —=VPeV ore 


6. Principle of least action — understanding physical optimization 6S =0 
7. Schrédinger equation — understanding quantum mechanics 


0 
jhR—V = HY 
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MELLIN TRANSFORM ...................0040.4 512 


Z-TRANSFORM ........... 0.000000 Fee eee 512 
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6.41 TABLESOF TRANSFORMS .................... aie 





6.1. CEILING AND FLOOR FUNCTIONS 


The ceiling function of x, denoted [x], is the least integer that is not smaller than «. 
For example, [7] = 4, [5] = 5, and [—1.5] = —1. 

The floor function of x, denoted |x|, is the largest integer that is not larger 
than x. For example, |7| = 3, [5] = 5, and |—1.5| = —2. 





6.2 EXPONENTIATION 


For a any real number and m a positive integer, the exponential a” is defined as 
a” =a:a-a::-a. (6.2.1) 
SS 
m terms 


The following three laws of exponents follow for a 4 0: 


1. a®-a™ =a™"™., a”’—", ifm>n 

m\n (mn) a™ ; 

2. (a™)™ = ann), 3. —=41, ifm=n, 
a 

—— , ifm<n. 


th 


The n" root function is defined as the inverse of the n'* power function: 


If b” =a, thenb = Ya=a"l/”), (6.2.2) 


If n is odd, there will be a unique real number satisfying the definition of ~/a, 
for any real value of a. If n is even, for positive values of a there will be two real 
values for ~/a, one positive and one negative. By convention, the symbol %/a means 
the positive value. If n is even and a is negative, then there are no real values for </a. 

To extend the definition to include a! (for ¢ not necessarily a positive integer), so 
as to maintain the laws of exponents, the following definitions are required (where 
we now restrict a to be positive, p and q are integers): 


1 
a&=-1 ata gt=— (6.2.3) 


m 
With these restrictions, the third law of exponents can be written as — =a 


m—-n 


If a > 1, then the function a® is monotone increasing while, if 0 < a < 1 then 
the function a” is monotone decreasing. 
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6.3 EXPONENTIAL FUNCTION 


exp(z) =e* = lim (1 + =) 
m 


m—0oo (63 1) 
1 2 gf gt - 
= aa ee Tae 
20 
15 . 
elIfz = a+ iy, then e* = e*e’Y = 
10 e*(cosy +isiny). 
e [eden 
5 dx 
e The value of e is on page 15. 
0 | 





6.4 LOGARITHMIC FUNCTIONS 


6.4.1 DEFINITION OF THE NATURAL LOGARITHM 


The natural logarithm (also known as the Napierian logarithm) of z is written as In z 
or as log, z. It is sometimes written log z (this is also used to represent a “generic” 
logarithm, a logarithm to any base). One definition is 


Inz= —, (6.4.1) 
1 t 


where the integration path from 1 to z does not cross the origin or the negative real 
axis. 

For complex values of z the natural logarithm, as defined above, can be repre- 
sented in terms of its magnitude and phase. If z = « + iy = re’, then 


Inz =Inr+i(6 +4 2kz), (6.4.2) 


for some k = 0,+1,..., where r = \/x?+y?, x = rcos6, and y = rsin@. 
Usually, the value of k is chosen so that 0 < (@ + 2k) < 2r. 
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6.4.2 LOGARITHMS TO A DIFFERENT BASE 


The logarithmic function to the base a, written log,, is defined as 


log,z — Inz 





log, z= (6.4.3) 


log,a Ina’ 
Note the properties: 


1. log, a? = p. 
2. log, b= 





log, a’ 
Inz 

3. logig z= ini (logy, e) Inz & (0.4342944819) In z. 
n 


4. Inz = (In 10) logyg z © (2.3025850929) logy, z. 


6.4.3 LOGARITHM OF SPECIAL VALUES 














e In(—1) = ia + 27ik eIne=1 ; 
e In0 = —oo e In(+i) = 7 4 nik 
e nl=0 2 


6.4.4 RELATING THE LOGARITHM TO THE EXPONENTIAL 


For positive values of z the logarithm is a monotonic function, as is the exponential 
for real z. Any monotonic function has a single-valued inverse function; the natural 
logarithm is the inverse of the exponential. If 2 = e”, then y = Inz, and x = e!™*, 
The same inverse relations hold for bases other than e. That is, if w = a”, then 
w = log, u, andu = qSa &, 


6.4.5 IDENTITIES 


log, 2122 = log, 21 + log, 22, for (—7 < arg z, + arg 22 < 7). 


log, aS log, 21 — log, 22, for (—7 < arg z1 — arg z2 < 7). 
22 


log, 2” = nlog, z, for (—7 < nargz < 7), when nis an integer. 
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6.4.6 SERIES EXPANSIONS FOR THE NATURAL LOGARITHM 








In(L+2)=2- 522+ 529—..., for |z| < 1. 
z-1 b/enl\* . ife=1y" 1 
6.4.7 DERIVATIVE AND INTEGRATION FORMULAS 


dig.) Ue te ponede= sine 2, 
Zz 


dz Zz 








6.5 TRIGONOMETRIC FUNCTIONS 


6.5.1 CIRCULAR FUNCTIONS 


Consider the rectangular coordinate system in Figure 6.1. The coordinate x is posi- 
tive to the right of the origin and the coordinate y is positive above the origin. The 
radius vector r shown terminating on the point P(x, y) is shown rotated by the angle 
a up from the x axis. The radius vector r has component values x and y. 

The trigonometric or circular functions of the angle a are defined in terms of 
the signed coordinates x and y and the length r which is always positive. Note that 
the coordinate x is negative in quadrants II and III and the coordinate y is negative 
in quadrants II and IV. The definitions of the trigonometric functions in terms of the 
Cartesian coordinates x and y of the point P(x, y) are shown below. The angle a 
can be specified in radians, degrees, or any other unit. 


sinea = sina = y/r, cosine a = cosa = 2/r, 
tangenta = tana = y/z, cotangenta = cota = a/y, (6.5.1) 
cosecanta = csca = r/y, secanta = seca =r/z. 


There are also the following seldom used functions: 
versed sine of a = versine of a = versa = 1 — cosa, 
coversed sine of a = versed cosine of ~ = coversa = | — sina, 
exsecant of a = exseca = seca — l, 
1 


haversine of a = hava = 5 versa = 4(1 — cosa). 
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6.5.1.1. Signs in the four quadrants 
I +/+] 4+ ]+]4+4+ 





FIGURE 6.1 


The four quadrants (left) and notation for trigonometric functions (right). 


Quadrants 





6.5.2 DEFINITION OF ANGLES 


If two lines intersect and one line is rotated about the point of intersection, the angle 
of rotation is designated positive if the rotation is counterclockwise. Angles are com- 
monly measured in units of radians or degrees. Degrees are a historical unit related 
to the calendar defined by a complete revolution equaling 360 degrees (the approx- 
imate number of days in a year), written 360°. Radians are the angular unit usually 
used for mathematics and science. Radians are specified by the arc length traced by 
the tip of a rotating line divided by the length of that line. Thus a complete rotation 
of a line about the origin corresponds to 27 radians of rotation. It is a convenient 
convention that a full rotation of 27 radians is divided into four angular segments of 
a /2 each and that these are referred to as the four quadrants using Roman numerals 
I, II, HI, and IV to designate them (see Figure 6.1). 

A right angle is the angle between two perpendicular lines. It is equal to 7/2 ra- 
dians or 90 degrees. An acute angle is an angle less than 7/2 radians. An obtuse 
angle is one between 7/2 and 7 radians. A convex angle is one between 0 and 7 
radians. 

The angle 7 radians corresponds to 180 degrees. Therefore, 


1 
one radian = = degrees = 57.30 degrees, 
i (6.5.2) 
one degree = 30 radians = 0.01745 radians. 
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FIGURE 6.2 


Definitions of angles. 


27,120°  $77,90° —- 47,60° 







3 ° 1 ° 
57,135 qm45 


57,1500 47,30° 
7,180° 07,0° 
27,360° 
T2102 
en 115 330° 
$1,225° t7,315° 


5 fo) 
5,300 


37,270° 


FIGURE 6.3 


Sine and cosine, angles are in radians. 





6.5.3 SYMMETRY AND PERIODICITY RELATIONSHIPS 


sin (—a) = — sina, cos (—a) = + cosa, tan (—a) =—tana. (6.5.3) 
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FIGURE 6.4 


Tangent and cotangent, angles are in radians. 





When n is any integer, 


sin (a + n27) = sina, 





cos (a + n2m) = cosa, (6.5.4) 


tan (a +n) = tana. 


6.5.4 ONE CIRCULAR FUNCTION IN TERMS OF ANOTHER 
For 0 <a < 7/2, 


1—sin?z | cosx 


sin x V1 — cos? x 


+ tan* x 


V1-—sin? x COS © aa 
1 1+tan? x 

V1 — cos? 2 tana 
: V1+tan? x 





COS & 


COS 


V1 — cos? x 
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+ cot? & 


ot x 





+ cot? x 


cot x 
V1+cot? 2 
V1+ cot? x 


cot x 


cot & 





6.5.5 CIRCULAR FUNCTIONS IN TERMS OF EXPONENTIALS 


e? +e ie = 
cos Z = ———_—— e~ =cosz+7siIn z 


a 


sin z = —————_ e '* =cosz—isinz 


tan z= = 





6.5.6 FUNCTIONS IN TERMS OF ANGLES IN THE FIRST 
QUADRANT 


When n is any integer: 
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6.5.7 FUNDAMENTAL IDENTITIES 


1. Reciprocal relations 








. 1 
sina = : 
CSC a 
1 
csca = ——, 
sina 


2. Pythagorean theorem 








sin? z+ cos? z = 1 


esc? z — cot? z =1 


3. Product relations 


sina = tanacosa 
tana = sinaseca 


seca = cscatana 


4. Quotient relations 








: tana 
sina = 
sec a 
sec @ 
csc a = 
tan a 


6.5.8 PRODUCTS OF SINE AND COSINE 
cos acos 3 = 5 cos (a B)+ 5 cos (a + 8). 


sinasin B = 5 cos (a ~ 8) - 5 008 (a +B). 


cot a 
cosa = 





CSC @ 


CSC @ 
seca = 





cot a 


1 








cosa cota’ 
cos @ 1 








sina tana 


sec? z—tan?z=1 


cosa = cotasina 
cot @ = cosacsc a 


csc @ = seca cot a 








sin @ 
tana = 

cos @ 

COS @ 
cota = — 

sin a 





1 1 
sina cos B = 3 sin (a — B)+ 5 sin (a + 6). 


6.5.9 ANGLE SUM AND DIFFERENCE RELATIONSHIPS 


sin (a + 3) = sinacos 8 4 


cos (a + 3) = cosacos fp J 


tan (a + 8) 





cot (a+ 8) = 




















cot 8B + cota 


_ tana +tan 8 
~ 1+tanatan 3 
cotacot B= 1 


t cosa sin 3 


F sina sin B 
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6.5.10 MULTIPLE ANGLE FORMULAS 


. . 2tana 
sin 2a = 2 sina cosa = ———,— 
1+ tan“ a 
sin 3a = —4sin°a + 3sina. 
sin4da = —8sin® acosa + 4sinacosa. 


sinna = 2sin(n — 1)acosa — sin(n — 2)a. 
: . 1—tan?a 
cos 2a = 2cos?a—1=1—2sin? a = cos? a — sin? a = —_ 
1+ tan? a 
cos 3a = 4cos* a — 3cosa. 
cos 4a = 8 cost a — 8cos?a + 1. 


cos na = 2cos(n — 1)acos a — cos(n — 2)a. 


2tana 
tan 2a = ———— 
1 — tan? a 
—tan?a+3tana 
tan 3a = —>——_—_ 
—3tan-a+1 
—Atan?a+4tana 
tan* a — 6tan*a+1 
tan(n — 1l)a+ tana 
tan Re = 
—tan(n—l)atana+1 
cot? a—1 
cot 2a = ————— 
2 cot a 


6.5.11 HALF ANGLE FORMULAS 


da = /1+ cosa 
Do 2 


(positive if a/2 is in quadrant I or IV, negative if in II or IID. 


_ a 1 — cosa 
sin ~ = +,/ ———_ 
2 2 


(positive if a/2 is in quadrant I or II, negative if in III or IV). 


a 1—cosa sin a 1 — cosa 
tan = = ——_ = — 4 
2 sin a 1+ cosa 1+cosa 


(positive if a/2 is in quadrant I or III, negative if in II or IV). 


ns 1+cosa sin @ 1+ cosa 
COL = — SS eh 
2 sin @ 1—cosa 1—cosa 


(positive if a/2 is in quadrant I or III, negative if in II or IV). 
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6.5.12 POWERS OF CIRCULAR FUNCTIONS 


sin? a = sl — cos 2a) cos? @ = sl + cos 2a) 
sin? a = a sin3a + 3sina) cos? @ = +(cos 3a + 3cos a) 
sint a = 58 —4cos2a+cos4a)  costa= 58 + 4cos 2a + cos 4a) 
eons See e 
1+ cos 2a 1 — cos 2a 


6.5.13 SUMS OF CIRCULAR FUNCTIONS 


















































; . : atp ayxtp 
sina +sin 6 = 2sin cos 
2 2 
a+ a= 
cosa + cos 3 = 2cos EF cos — 
Qa a 
cos@ — cos 3 = —2sin B sin 5 B 
sina + sinBta 
anges =: siete eS 
cos acos 3 sin asin 3 
sna+sin@ tan vit sina + sin 6 as + 6 
eS ———————. = co 
sin aw — sin 8 tan 4 cos a — cos B 2 
sina + sin 6 a+ sina — sin G a-—pB 
st ee CS CMTE 
cosa + cos 3 2 cosa + cos 8 2 





6.5.14 CIRCULAR FUNCTIONS AS SERIES 
See Section 1.9.6.4 on page 60. 


6.5.15 RATIONAL TRIGONOMETRY 


“Rational trigonometry” is a new approach to trigonometry. Whereas (usual) 
trigonometry considers distance and angles as fundamental quantities, Rational 
trigonometry uses quadrance and spread. 


1. A point is an ordered pair of numbers A = [x, y]. Two points define a line ¢. 


2. The quadrance between points A, = [21, yi] and Ay = [x2, yo] is the number 
Q(A1, Ao) = (21 — 22)? + (yi — y2)? = Que (6.5.5) 


3. For the points {A1, Az, A3} define: Q23 = Q(Ao, As), Qi3 = Q(A1, As), 
and Qi2 = Q(Ai1, Ag). If the points {A1, Az, A3} are collinear (i.e., are on 
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the line ax + by + c = 0) then the Triple quad formula holds: 


(Qiz + Q23 + Qis)* = 2 (Qi + Q33 + Qi2) (6.5.6) 


which can be written as 
(Qo3 + Qis — Qiz)” = 4Q23Q13 (6.5.7) 


4. Consider two lines: ¢; (defined by a,x + by + cy, = 0) and @2 (defined by 
agx + boy + cg = 0). The spread of the lines @; and ¢2 is the number 


(abo = ab)? 


Oe ee a 
(8) = ES (aE +B) 


= 8(€5, £1) (6.5.8) 


(a) The spread s is in [0, 1] and is the square of the sine of the angle. 
(b) If s = 0 then the lines are parallel and a, bz — azb, = 0 
(c) If s = 1 then the lines are perpendicular and a a2 + bi b2 = 0 


(d) The spread of lines meeting: at an angle of 30° or 150° is s = 1/4; at an 
angle of 45° or 135° is s = 1/9; at an angle of 60° or 120° is s = 3/4. 


5. Main laws of rational trigonometry: 
(define Sijk = 38(Li7, Cir) = s(A;A,, Aj Ar) = Si,kj) 


(a) Pythagoras’ theorem The lines A; Az and A2 Az are perpendicular pre- 
cisely when Q23 + Qi3 = Qi. 

(b) Spread law (similar to the law of sines) 
For the triangle created by the points {A;, Az, As} 


$1,23 $2.13 53,12 











— = (6.5.9) 
Qo3 Q13, Quiz 
(c) Cross law (similar to the law of cosines) 
For the triangle created by the points {A,, Az, A3} 
(Qos + Qis — Qiz)” = 4Q23Q1a (1 — 83,12) (6.5.10) 
SS 


the “cross” 


(d) Triple spread law For the triangle created by the points {A;, Az, A3} 


(s1,23 + $2,13 + 83,12) = 2 (87,03 + $3.13 + 83,12) + 481,2382,1383,12 
(6.5.11) 
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6.6 CIRCULAR FUNCTIONS AND PLANAR 
TRIANGLES 


B 
B 
c a ‘ x 
A C A ai e 
b b 
Right triangle General triangle 


6.6.1 RIGHT TRIANGLES 


Let A, B, and C be the vertices of a right triangle with C the right angle and a, b, 
and c the lengths of the sides opposite the corresponding vertices. 


1. Trigonometric functions in terms of the sides of the triangle (a mnemonic is 
SOH-CAH-TOA) 








. a opposite 1 

sin A = — = ——— = 
c hypotenuse cscA 
b dj t 1 

mle ao ee (6.6.1) 
c hypotenuse sec A 

a ae OEpee _ il 
b adjacent cot A 


2. The Pythagorean theorem states that a? + b? = c?. 
3. The sum of the interior angles equals 7, thatis A+ B+C =n. 


6.6.2 GENERAL PLANE TRIANGLES 


Let A, B, and C be the interior angles of a general triangle, let a, b, and c be the 
length of the sides opposite those angles, and let s = 4 (a+ b-+c) be the semi- 
perimeter. 


(—ajs—bis—o 


1. Radius of the inscribed circle: r= 4/ —_——————_, 
8 


2. Radius of the circumscribed circle: 
a b c abc 


~2snA 2sinB 2sinC 4(Area)’ 
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a b Cc 
snA  sinB sinC’ 





3. Law of sines: 


4. Law of cosines: 


2 4b? — a2 
































a? = c? +b? — 2becos A, cos A = 
2bc 
24 2 _ 72 
b? = a? +c? — 2cacos B, iene 
2ca 
b2 ana 
c? = b? +a? — 2abcosC, aS 
2ab 
5. Triangle sides in terms of other components: 
a=bcosC + ccosB, 
b=acosC + ccosA, 
c=bcosA+acosB. 
6. Law of tangents: 
a+b tan 42 b+e tan 2£¢ 
a—b tan 458’ b—-c tan 25€’ 
ate | tan — 
a—c tan ane 
7. Area of general triangle: 
Ae besin A 7 acsin B - as 
2 2 
_c@sinAsinB  b?sinAsinC _ asin BsinC 
—  QsinC 2sinB — 2sinA 
b 
=rs= in = \/s(s — a)(s — b)(s —c) (Heron’s formula). 
8. Mollweide’s formulas: 
b—c__ sin3(B—C) c—a_ sing(C— A) 
a costA b = cos dB’ 
a—b_ sin3(A—B) 
¢ cos 4C 
9. Newton’s formulas: 
b+e  cos3(B-—C) c+a__ cos3(C— A) 
a sin 5A , b sin 4B 
a+b coss(A—B) 





Cc sin 4C 
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FIGURE 6.5 


Different triangles requiring solution. 


6.6.3 SOLUTION OF TRIANGLES 


A triangle is totally described by specifying any side and two additional parameters: 
either the remaining two sides (if they satisfy the triangle inequality), another side 
and the included angle, or two specified angles. If two sides are given and an angle 
that is not the included angle, then there might be 0, 1, or 2 such triangles. Two angles 
alone specify the shape of a triangle, but not its size, which requires specification of 
a side. 


6.6.3.1 Three sides given 
Formulas for any one of the angles: 
c? +b? — a? 


: 2 
cos A = —— sin A= s(s — a)(s — b)(s —), 


_A_/@—dis—oc) A /s(s—a) 
n> = —, ay = 1 ; 


tan 2 — ,/ ST os—o)_ 
2 s(s—a) s—-a 


6.6.3.2 Given two sides (b,c) and the included angle (A) 


See Figure 6.5, left. The remaining side and angles can be determined by repeated 
use of the law of cosines. For example, 


1. Non-logarithmic solution; perform these steps sequentially: 
(a) a? = b? +c? — 2bccos A 
(b) cos B = (a? +c? — b?)/2ca 
(c) cosC = (a? + b? — c?)/2ba 
2. Logarithmic solution; perform these steps sequentially: 
(a) B+C=7-A 
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(b) tan 5 bre” 5 
(c) B= —— + . 
C Bec 
(a) a 8 
sin 
(©) ain B 


6.6.3.3 Given two sides (b,c) and an angle (C), not the included 
angle 
See Figure 6.5, middle. The remaining angles and side are determined by use of the 
law of sines and the fact that the sum of the angles is 7, A+ B+C =r. 
bsinC bsin A 


sin B= : A=7-B-C, a= 


; 6.2 
Cc sin B K6:0:2) 








6.6.3.4 Given one side ()) and two angles (2, C) 


See Figure 6.5, right. The third angle is specified by A = 7 — B—C. The remaining 
sides are found by 








bsin A bsinC 
a= = 


snB’? ~~ sinB’ tee) 


6.6.4 HALF ANGLE FORMULAS 

















; A r ‘ Bor ; Cor 
oe y= —a a el —b Oe Fae 
A /(s—b)(s—c) A /[s(s—a) 
a eal bc ac ee be 
B = = = 
sin = (s —c)(s — a) oe B_ s(s — b) 
2 ca 2 ca 
= —b = 
i C = (s—a)(s ) rs Cc _ s(s —c) 
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6.7 TABLES OF TRIGONOMETRIC FUNCTIONS 


6.7.1 CIRCULAR FUNCTIONS OF SPECIAL ANGLES 
Ed CSE SL 





A/a) Aaa 
2 (\/3 — 1) “2/3 -1) 
24+ V3 —(2+ V3) 
V2(v3 — 1) V2(v3 — 1) 
V2(v3 + 1) —J2(V3 + 1) 
2-3 —(2—+/3) 


—2(V3+1) 
—(2— v3) 
V2(vV3 + 1) 
—J2(V3 - 1) 
—(2+ V3) 


sin nt 
cos nT 
sin nw /2 
cos nr /2 








n odd n/2odd  n/2 even 
ane ODE VE (aAye-BA 0 


Note the useful formulas (where i? = —1) 
gntl 
2 


_ nt 
sin — = 
2 





[((-1)" — 1], cos = (iy? 44), (6.7.1) 


438 CHAPTER 6. SPECIAL FUNCTIONS 


6.7.3. TRIGONOMETRIC FUNCTIONS FOR DEGREE 
ARGUMENTS 


(degrees) 
x sin x COS & tan x cot x sec x csc & 
0 0 1 0 =koo 1 =koo 


0.0875 | 11.4300] 1.0038} 11.4737 
0.1763 | 5.6713] 1.0154] 5.7588 
0.2680 | 3.7321] 1.0353] 3.8637 
0.3640 | 2.7475] 1.0642] 2.9238 
0.4663 | 2.1445] 1.1034] 2.3662 
0.5774] 1.7321] 1.1547] 2.0000 
0.7002 | 1.4282] 1.2208] 1.7434 
0.8391] 1.1918] 1.3054] 1.5557 
1.0000} 1.0000} 1.4142] 1.4142 
1.1918] 0.8391} 1.5557] 1.3054 
1.4282] 0.7002} 1.7434] 1.2208 
1.7321] 0.5774) 2.0000] 1.1547 
2.1445] 0.4663] 2.3662] 1.1034 
2.7475 | 0.3640] 2.9238] 1.0642 
3.7321] 0.2680] 3.8637] 1.0353 
5.6713 | 0.1763] 5.7588] 1.0154 
11.4300} 0.0875 | 11.4737] 1.0038 
0 1 


—0.2680 : 1.0353 
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6.7.4 TRIGONOMETRIC FUNCTIONS FOR RADIAN 
ARGUMENTS 


(radians) 
x sin x COS & tan x cot x sec x csc x 
0 0 1 0 soo 1 =koo 


1.0050 | 10.0167 
1.0203 | 5.0335 
1.0468 | 3.3839 
1.0857 | 2.5679 
1.1395 | 2.0858 


1.2116} 1.7710 
1.3075 | 1.5523 
1.4353 | 1.3940 
1.6087 | 1.2766 
1.8508} 1.1884 


2.2046} 1.1221 
2.7597 | 1.0729 
3.7383 | 1.0378 
5.8835 | 1.0148 
14.1368} 1.0025 














SECO 1 
—34.2325 ‘ —34.2471 | 1.0004 
—7.6966 : —7.7613 | 1.0084 
—4,2863 . —4,4014] 1.0269 
—2.9271 ; —3.0932 | 1.0567 
—2.1850 : 1.0998 


—1.7098 ; : 1.1585 
—1.3738 : : 1.2369 
—1.1192 : ; 1.3410 
—0.9160 : : 1.4805 
—0.7470 : : 1.6709 


—0.6016 : : 1.9399 
—0.4727 : . 2.3398 
—0.3555 ; : 2.9852 
—0.2464 : : 4.1797 
—0.1425 : 7.0862 
—0.0416 | —24.0288 : 24.0496 

0 soo soo 
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6.8 ANGLE CONVERSION 


0.0174533 0.00029089 0.000004848 1 
0.0349066 0.00058 178 0.0000096963 
0.0523599 0.00087266 0.0000145444 
0.0698 132 0.001 16355 0.0000193925 
0.0872665 0.00145444 0.0000242407 


0.1047198 0.00174533 0.0000290888 
0.1221730 0.00203622 0.0000339370 
0.1396263 0.00232711 0.0000387851 
0.1570796 0.00261799 0.0000436332 
0.1745329 0.00290888 1 0.00004848 14 


57.2958 5.7296 
114.5916 : ; 11.4592 
171.8873 : : 17.1887 


229.1831 : ; 22.9183 
286.4789 : . 28.6479 
343.7747 : : 34.3775 
401.0705 : : 40.1070 
458.3662 : : 45.8366 
515.6620 : . 51.5662 
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6.9 INVERSE CIRCULAR FUNCTIONS 
6.9.1. DEFINITION IN TERMS OF AN INTEGRAL 
are sin(z) = sin" + z= [ = 
- = o V1-#’ 
1 
arc cos(z) = cos? z = | 4 - 5 —sin™'z, (6.9.1) 
tan(z) = tan? -[ ag 
arc tan(z) = tan™* z= tee 2 Zz, 


where z can be complex. The path of integration 


must not cross the real axis in the 


first two cases and the imaginary axis in the third case except possibly inside the unit 


1 


circle. If —1 < x < 1, then sin’! x and cos-! x 


0<cos-la<q. 


esc” + z =sin~+(1/z 


sec-! z = cos~ 


( 
( 


cot! z = tan7 


sec! z+ese7tz= 


are real, —5 < sino ta < $, and 


), 


(1/2); 
1/z), 


(6.9.2) 


m/2. 


6.9.2 PRINCIPAL VALUES OF THE INVERSE CIRCULAR 


FUNCTIONS 


The general solutions of {sint = z, cost = z, tant = z} are, respectively: 


t=sin~' zg = (—1)*to + kz, 
+t, + 2kz, 





t = cos 
t=tan!z =tot+kn, 


1 


where /; is an arbitrary integer. While “‘sin™* 2” 


with sinto = z, 
with cost; = z, 


with tan tg = z, 


> can denote, as above, any angle 


whose sin is 7; the function sin~' x usually denotes the principal value. The princi- 
pal values of the inverse trigonometric functions are defined as follows: 


1. When —-1<a<1, then—7/2<sin ‘a < 7/2. 
2. When —1<a2<1,_ then 0<cos-la <n. 

3. When —oo < x <0, then —7/2 < tan-! x < 7/2. 
4. When 1 <a, then O<cse7ta < 7/2. 
When x <-—1, then —7/2<csc7ta <0. 

5. When 1 <2, then 0<sec7ta < 7/2. 
When x<-—l, then 7/2 <secta <7. 

6. When —oo < « <ow, then O0<cot'a<q. 
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6.9.3 FUNDAMENTAL IDENTITIES 
sin- z+ cos? a4 = 1/2 tan’ 2+ cot 's = 7/2 


Ifa=sin x, then 
x 


sina = @, cosa = V1 — 22, tana = ———., 
Jl — x2 
1 
csca = —, seca = ————_,, cota = 
x 1 2 x 
If a = cos! a, then 


: 1 
sina = V1 —2?, cosa = a, tana = ———_, 
csc a = 

V1 — x2? 


Ifa =tan! 2, men 


sina = cosa = 


/1 Yard 14 72’ 
vita 5 1 
1+2 cota=-. 

x 


csc a = seca = 








6.9.4 FUNCTIONS OF NEGATIVE ARGUMENTS 


sin-' (—z) = —sin™*z, sec”! (—z) =m —sec”*z, 
cos" (—z) = a —cos *z, esc” * (—z) = — ese’ z, 
tan~' (—z) =—tan*z, cot! (—z) =x —cot"1z 


6.9.5 SUM AND DIFFERENCE OF TWO INVERSE 
TRIGONOMETRIC FUNCTIONS 








sin! Za sin! 22 sin! (a 1- aA E z94/1— 4). 


























cos! z; + cos”! z. = cos~ Ve F4/(1— 28)(1—- 8). 
= 21 1 22 
tan’! Zz, £tan~ lyn= =tan ~ | ——— ]}. 
se 2122 
sin’ z, + cos~! zz = sin™ ' (az +,/(1— 2?)(1 )), 





= 608" ' (ayi-# 1-2=z 1-4). 


= _ _ £129 = 1 = 2g F zy 
tan Vey + cot ly, = tan rae} =cot7!{ = ). 
Za FZ 2122 = 1 


These formulas shown presume principal values of the inverse functions. 
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6.10 HYPERBOLIC FUNCTIONS 





ee? =e" 1 
sinh z = ————., csch z = ——, 
2 sinh z 
Zz —2 
e+e 1 
cosh z= ——5—_, sechz = 
cosh z 
e?—e *  sinhz 1 
tanh z = ———— = , coth z = ———. 
e* +e cosh z tanh z 





When z = x + 2y, 


: ; . ; sinh 2a + isin 2 
sinh z = sinha cosy + 7coshz sin y, tanh z = iene aU Ease 
cosh 2x + cos 2y 
sinh 2x — isin 2y 
cosh z = cosha cosy +isinhz sin y, coke = EE 
cosh 2x” — cos 2y 


Domain Range 


(interval of u) (interval of function) Remarks 


Function 





Two branches, 
pole atu = 0. 





Two branches, 
pole atu = 0. 























6.10.1 RELATIONSHIP TO CIRCULAR FUNCTIONS 


cosh z = cosiz, sinh z = —isiniz, tanh z = —itaniz. 
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6.10.2 HYPERBOLIC FUNCTIONS IN TERMS OF ONE 
ANOTHER 


tanh x 
1 — (tanh x)? 
1 





sinha = sinh x t \/(cosh a)? — 1 


cosh xz = 1+ (sinh x)? cosh x ————_——— 
( ) 1 — (tanhz)? 
sinh (cosh)? — 1 

tanh a2 = | ——————— _ | + > __ tanh x 
1+ (sinh x)? cosh x 

1 1 1 — (tanhz)? 

sinh x a (cosh x)? — 1 tanh x 

1 
secha = | ———————— — 1 — (tanh x)? 
1+ (sinh x)? cosh 





esch xz = 





+ (sinh a)? cosh x 


sinh « ~ 4/(cosh x)? — 1 





; 1 \/1 — (sech x)? 
sinha = ——_ ee ee i 
esch © sech x (coth x)? — 1 








(csch x)? + 1 1 | coth x 
esch x sech x ~ 4/(coth x)? — 1 
1 1 


tanhe =| ———————. | _ +/1 — (sech a)? ——. 
(csch x)? + 1 coth a 








cosha = | + 





r 
esch x = cesch x | (coth a)? — 1 


~ 4/1 — (sech x)? 


sch thax)? —1 
sech xz = fo sech x Vv (coth x)? — 1 
(csch x)? + 1 coth x 


1 
cothz = (cschx)? +1 | +—————— cothz 


~ 4/1 — (sech 2)? 




















6.10.3 RELATIONS AMONG HYPERBOLIC FUNCTIONS 
e* =coshz+sinhz, e * =coshz — sinhz, 


(cosh z)? — (sinh z)? = (tanh z)? + (sech z)? = (coth z)? — (esch z)? = 1. 
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6.10.4 SYMMETRY RELATIONSHIPS 


cosh (—z) = + cosh z, 


6.10.5 SERIES EXPANSIONS 


6.10.6 


6.10.7 


cosh (z1 + 22) = cosh 21 cosh z 4 


tanh (z1 + z2) = 


coth (21 ae 22) = 














sinh (—z) = —sinh z, 























coth z; + coth 


6.10.8 SUMS OF FUNCTIONS 


sinh u + sinh w = 2 sinh 





cosh u + cosh w = 2 cosh 


cosh u — coshw = 2 sinh 


tanh z; + tanh z2 
1+tanhz,tanhz.  cosh2z; + cosh 2z5’ 
1+ coth z; coth zg 


SUM AND DIFFERENCE FORMULAS 


tanh (—z) = — tanh z. 


a ae 
coshz=l+ tate te |z| <0 
. a ee 
sinhz= zt tata tes |z| <0 
tanh z = z ge | Lee 
3 Tg BIB ro 
PRODUCTS OF FUNCTIONS 
1 
sinh usinh w = 5 (cosh(u + w) — cosh(u— w)), 
1 
sinh ucoshw = 5 (sinh(u + w) + sinh(u — w)), 
1 
cosh u cosh w = 5 (cosh(u + w) + cosh(u — w)). 


t sinh z1 sinh 22, 


sinh (z1 + z2) = sinh z1 cosh zg + cosh 2 sinh 22, 
sinh 2z, + sinh 2z9 





sinh 2z, + sinh 2z9 





z. cosh 2z1 — cosh2z9 





Ux W 





uUu+ Ww 





bai sinh 








sinhu + w 





tanhu + tanhw = 


sinh 





cothu + cothw = 


cosh u cosh w’ 





Ur W 


sinh u sinh w 











2 5) 
Ut 


9 ? 
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6.10.9 HALF—ARGUMENT FORMULAS 


ua, cosh z — 1 
sinh = = +4/ —~—_, 
2 2 
tanl Zz cosh z — 1 sinh z 4 z 
a -=2 SO FS CO = 

a V coshz +1 coshz+1’ "39 





Zz 
he 
oy 








cosh z+ 1 

2 
i cosh z+ 1 
~V coshz— 1 


6.10.10 MULTIPLE ARGUMENT RELATIONS 


2tanha 


sinh 2a = 2sinhacosha = 


1 — tanh? a 


sinh 3a = 3sinha + 4sinh® a = sinh a(4 cosh? a — 1). 


cosh 2a = cosh? a + sinh? a = 2cosh? a — 1, 


cosh 3a = —3cosha + 4cosh® a = cosha(4 sinh? a + 1). 


=1+2sinh?a = 


2tanha 
tanh 2a = ———.—. 
1+ tanh* a 
tanh 3a _3 tanha + tanh? a 
1+ 3tanh? a 
1+ coth?a 
th 2a = ——————_ 
oe 2 cotha 
_ 3coth th? a 
1+ 3coth* a 


1+ tanh? 
1 — tanh? 


a 


a 


sinh z 


~ coshz— 1° 


6.10.11 SUM AND DIFFERENCE OF INVERSE FUNCTIONS 


Liar 
sinh 
cosh”! 
=1 
tanh ~ x 


sinh! x 


tanh 





a + cosh’ y = cosh™! (zy an 





+ tanh’ y = tanh~* ( —= 


i) 


+ cosh7' y = sinh7! (xy+ 





z+sinh 'y=sinh ' (xv 1l+y?+ 











ry 




















a +coth”’y = tanh~ a 
yYrr 





ryt1 








y 1+27), 


Fe =), 


G+2)G7-1), 
= cosh! (uv Ll+a?+ a + ey/y?—1) : 
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6.11 








6.11.1 


sinh”! = log (x + 4 / 72 + 1), 


Odd functio 


INVERSE HYPERBOLIC FUNCTIONS 


n 


Even function, double valued 


Odd functio 


n 


Odd function, two branches, 


pole atu = 











cosh~' x = log (x + V2? 1), 


1 l+z 
tanh7* «= 5 los ( == 
1-2 





2 


0 


Double valued 


Odd functio 





n, two branches 


RELATIONSHIPS WITH LOGARITHMIC FUNCTIONS 





4 ltVJ14+2? 
csch ~ xz = log | ——————_ ], 
x 
4 ltivl—-<27? 
sech ~ a = log | —————— ], 
x 





1 >+1 
coth he = 5 tog (= ) 


2 


x—1 


6.11.2 RELATIONSHIPS WITH CIRCULAR FUNCTIONS 


sinh! = —isin~! ix 
tanh! 2 = —itan~! iz 
esch”} & = +icse ix 
coth 12 = +icot ir 








sinh tia = +isin7! x 
tanh liz = +itan tx 
esch | ix = —icse ax 
coth tix = —icot-! x 


6.11.3. DIFFERENTIATION FORMULAS 





= cosh z, 








= (sech z)?, 


= —sech z tanh z, 


= sinh z, 











= —cschzcothz, 


= —(csch z)?. 
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6.11.4 RELATIONSHIPS AMONG INVERSE HYPERBOLIC 
FUNCTIONS 














t tanh! V1 — 22 











1 
tanh~! — 
x 


1 
V1+ x2 


t sech”? coth + 





JIte 
x 


x 
z?—1 








1 
sech~! — +coth! 
x 





1 
+sech~! /1 — 2? coth + — 
x 


t sech”? = coth ! V1 + 22 
x 





1 
V1— x? 





sech tx + coth” + 





Vane —1 


x 


= =, 
sech coth “a 
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6.12 GUDERMANNIAN FUNCTION 


2 


—5 —3 —l 1 3 5 
This function relates circular and hyperboliczfunctions without the use of functions 
of imaginary argument. The Gudermannian is a monotonic odd function which is 
asymptotic to +5 as x — oo. It is zero at the origin. 











gda = the Gudermannian of x 


* dt 
= i =2tan! (tanh ~) = 2tan7!e* — 
9 cosht 2 





wl] a 


= . ; (6.12.1) 
gd ~ x = the inverse Gudermannian of x 


go cost 


If gd(a + ty) = a +28, then 


TS 
= log [tan (F + =) = log (secx + tan x). 














sinh « sin y 
tana = ; tanh 6 = ; 
cos y cosh x 
sin @ sin 3 
tanh az = ; tany = ; 
cosh 8 cosh a 


6.12.1 FUNDAMENTAL IDENTITIES 


tanh (5) = tan (5). 


x 


e* =cosha +sinhx = secgdaz + tangdz, 
er tees _ i+sin (gd 2) 
4 2 cos(gd x) 
igd' x = gd7"(iz), where i = /—1. 


6.12.2 DERIVATIVES OF GUDERMANNIAN 
d(gd) d(gd~* x) 
dx 


= sech x ———_ = secn. 


dx 
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6.12.3 HYPERBOLIC TO CIRCULAR FUNCTIONS 


sinh z = tan (gd2), esch x = cot (gd), 
cosh a = sec (gd), sech x = cos (gd), 
tanh x = sin (gd), cotha = csc (gd 2). 


6.12.4 NUMERICAL VALUES OF HYPERBOLIC FUNCTIONS 
0 1 —oo 0 0 1 0 


7.3891 

8.1662 

9.0250 

9.9742 
11.0232 
12.1825 
13.4637 
14.8797 
16.4446 
18.1741 
20.0855 10.0179 | 10.0677 
22.1980 11.0765 | 11.1215 
24.5325 12.2459 | 12.2866 
27.1126 13.5379 | 13.5748 
29.9641 14.9654 | 14.9987 
33.1155 16.5426 | 16.5728 
36.5982 18.2855 | 18.3128 
40.4473 20.2113 | 20.2360 
44.7012 22.3394 | 22.3618 
49.4024 24.6911 | 24.7113 
94.5982 27.2899 | 27.3082 
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6.13 ORTHOGONAL POLYNOMIALS 


Orthogonal polynomials are classes of polynomials, {p,,(2)}, which obey an orthog- 
onality relationship of the form 


[ew Pn(®) Pm (x) dx = CnOnm (6.13.1) 
I 


for a given weight function w(x) and interval I. 


6.13.1 HERMITE POLYNOMIALS 


Symbol: H,,(«) 
Interval: (—00, 00) 
Differential Equation: y” — ay’ + 2ny =0 
[n/2| = 
—1)™nl(2Qx)” 2m 
Explicit Expression: H,(a) = x eae 
Recurrence Relation: Ay41(x) = 2a, (x) — 2nHp-1(2) 
Weight: ee 
Standardization: A, (x) = 2"a" +... 
Norm: a e-® [H,(2)|° dx =2'nl/r 
Rodrigues’ Formula: H,(x) = (—1)"e”" ae) 
Generating Function: y H,,(x)— = eo * tien 
n! 

n=0 

Inequality: |Hn(x)| < V2"e"*n! 


6.13.2 JACOBI POLYNOMIALS 


Symbol: Pio) (x) 
Interval: [—1, 1] 
Parameter Range: a,B>-1 
Differential Equation: 


(1—27)y" + [B-—a-(a+8+2)aly¥ +n(nta+f8+)y=0 
Explicit Expression: 
api “. (nta\(n+6 eae 
AP aaa (TRA e +n 
Recurrence Relation: 
(n+ 1)(n+a+ B+1)Qn+a+ BPO? (x) 
= (2nt+a+6+1)[(o? — 6?) + Qn+a+84+2)(Qn+a+4+ B)c] Pi? 
~2(n +.a)(n + B)(Qn+ a+ B+2)P\v? 
Weight: (1—«)*(1 +2)? 
Standardization: P&™P) (1) = Cl 


n 
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a a 2 at+8+1p(nta A 
Norm: fo —2)*(1+2)F [Ps (e)| dx ( 
Rodrigues’ Formula: 
—1)" d” 
Plo) =_ ee a) ee —_ n+ta 1 ee n+B 
n (x) 2rni(1 = x)o(1 + xe dx” [( x) ( x) | 


Generating Function: 


S > PA“) (a)2™ = 2°PR (1-2 +R) %(1+24+ R)%, 


n=0 
where R = V1 — 2xz4 2 and |z| <1 


Inequality: 
mtd) 4, if g = max(a, 8) > — 
ees Pi) (2)| = ( ah ’ ( ) = 
—l<#<l [Ps (ae!) 
where a, 3 > 1 and 2’ (in the second result) is one of the two maximum points 
nearest (3 — a)/(a+6 +41). 


6.13.3. LAGUERRE POLYNOMIALS 


Symbol: Lyla): 
Interval: (0, 00). 


~n V2, if gq =max(a,B) < —4 





L,,(x) is the same as L® (x) (see the generalized Laguerre polynomials). 


6.13.4 GENERALIZED LAGUERRE POLYNOMIALS 





Symbol: L& (a) 
Interval: [0, 00) 
Differential Equation: ry” +(a+1—2)y' +ny =0 
ie —|ym 
Explicit Expression: L') (x) = ss (-1) (" + ae 
m=0 m!} m—m™m 


Recurrence Relation: 
(n+ 1)LE), (a) = [Qn +a +1) — a]L9)(a) — (nt a) LO, (2) 








Weight: wren” 
—1)" 
Standardization: L') (2) = ( ) e+... 
n! 
um 2 |B 1 

Norm: | pie Le (z)| dz = a) 

0 ‘ an ne 
Rodrigues’ Formula: L‘) (¢) = ———_ ere 

a nlave—* da” 
Generating Function: > L') (z)z™ = (1 — z)~*-1 exp (=) 

z— 

n=0 

Inequality: 
T(n+a+1) x/2 : 
ares) . pirtart) © i ifx >Oanda>0, 
- 2 et et/?, if >O0and-1<a<0. 





Note that a > —1 and L(x) = (—1)™ eee ie 
Xx 
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6.13.5 LEGENDRE POLYNOMIALS 








Symbol: P,(2) 
Interval: [—1, 1] 
Differential Equation: (1 — 2)y" — Qay’ + n(n+1)y =0 
Explicit E. a B@= 1 x 1" n\ (2n-—2m\ om 
xplicit Expression: n(2) = 55 2 i . x 
Recurrence Relation: (n+ 1)Pr41(x) = (2n + 1)eP, (x) — nPp-1(x) 
Weight: i 
Standardization: P,(1) =1 
1 
2 
Norm: P, 2 da = 
orm ne [Pr(a)]° dx mal 
. , (le d”" 2\n 
Rodrigues’ Formula: P,(x) = —|(1 —2*)”] 
} ; 2°n! dx” 
Generating F unction: 
se = (1 — 2ez+27)-'/?, for —1 < x < land |z| <1 
n=0 
Inequality: |P,(a)| <1for-l<a<1 


See Section 6.24.5 on page 486. 


6.13.6 CHEBYSHEV POLYNOMIALS, FIRST KIND 


Symbol: T(x) 
Interval: [—1, 1] 
Differential Equation: (1—2?)y"” — ay’ +n?y =0 
Explicit Expression: 
n ee (n —m—1) 
Tile) = cos (cos a) = 5 »D (-1)™ =o) (Qa\r-s" 
Recurrence Relation: Tn41(@) = 2eT, (x) — Ty-1(2) 
Weight: (i—9)-% 
Standardization: Tn(1) =1 
1 ais 2 T, n=V, 

Norm: 1—2?)-1/2 (7, (x)/* dr = 

ea a 


Rodrigues’ Formula: 
Generating Function: 


1- 
> Ta(w)z” = ——"~, for -1 < @ < Land |z| <1 
1—29z+4+ 2? 


n=0 
Inequality: \T,(x)| <1 for-l<a<1 





! 
Note that T;,(a) = ee Tr) Pe 1/2, 1/2) (q ). 
nr 
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6.13.7 CHEBYSHEV POLYNOMIALS, SECOND KIND 


Symbol: Un (x) 
Interval: [—1, 1] 
Differential Equation: (1 — x)y" — 32y’ + n(n+2)y =0 
LW?! (_1)™(n — m)! 
Explicit Expression: Un (x) = »» ice ee eee 
i 1)6 
and = U,,(cos@) = uae 
sin 6 
Recurrence Relation: Un4i(x) = 22U,,(x) — Un-1(2) 
Weight: (iat? 
Standardization: U,(1)=n+1 
1 
Norm: _, (1 —2)/? [Up (a)? dx = 5 
-1 
Rodrigues’ Formula: 
Un(a) = es ry — garry 
n (1 = g)\1/29n+11(n, + 3) dx” 
Generating Function: 
= 1 


Sua)" = loess for —1 <a < land |z ,<1 


Inequality: [Un (a)| <n+1for-l<a<1l 
Note that U;,(x) = 


6.13.8 TABLES OF ORTHOGONAL POLYNOMIALS 


6.13.8.1 Table of Jacobi polynomials 
Notation: (m), = m(m+1)...(m+n-—1). 











PL“P) (gp) = 1. 
PA“) (a) = 5 (2(a+1) + (a+ 8 +2)(e-1)). 
PIO) (n) = 5(4(0 +1)2+4(at+ 8 +3)(a+2)(@-1) + (a+ +3)o(e—- 1)?). 
PLO?) (x) = 5 (8 (a+ 1)3 + 12(a+ 6 + 4)(a + 2)2(x — 1) 

ae + (a+ 8 +4)3(x-1)°). 
Pie(a) = = (16(a + 1)4 + 32(a+ 8 + 5)(a + 2)a(# — 1) 


+ 24(a+ 8 +5)o(a+ 3)o(x2 —1)? +8(a+ 8 +5)3(a + 4) (x — 1)° 
ca (a+ 8 +5)4(@-1)4). 
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6.13.9 TABLES OF ORTHOGONAL POLYNOMIALS (H, L, P, T, U) 





























































































































Ho =1 = (1680Hp + 3360H2 + 840H4 + 56H6 + Hs) /256 
Hy = 2a = (840, + 420H3 + 42H5 + H7)/128 
Hy = 16x* — 48a? + 12 = (120Ho + 180H2 + 30H4 + He) /64 
Hz = 4a? — 2 x = (60H, + 20H3 + Hs) /32 
Hz = 82° — 122 a* = (12Ho + 12H2 + H4)/16 
Hs = 322° — 160x° + 120x = (6H; + H3)/8 
He = 642° — 4802* + 720ax? — 120 x? = (2Ho + Ho) /4 
Hy = 1282" — 13442 + 33602? — 1680a x = (H1)/2 
Hg = 256a° — 35842°° + 134402 — 134402? + 1680 1=Ho 
Lo=1  «#® =720Lo9 — 4320L1 + 10800L2 — 14400L3 + 10800L4 — 4320L5 + 720L6 
iy ==o+1 x = 120Lo — 600L1 + 1200L2 — 1200L3 + 600L4 — 120L5 
la = (2? —4r+ ,2)/2 xt = 2409 — 961, + 144L2 96L3 + 24D4 
Lz = (—a? + 9a? — 18a + 6)/6 x® = 6Lo — 18L1 + 18L2 — 6L3 
La = (a* — 16a? + 72x? — 96a + 24) /24 x? = 2Lo — 411 + 2L2 
Ls = (—a° + 25a* — 2002? + 6002? — 600x + 120)/120 x=LIo—ly 
Le = («° — 36a° + 450x* — 240023 + 54002? — 43202 + 720)/720 1=Lo 
Po=1 ax® = (715Po + 2600P2 + 2160P: + 832Pe + 128Ps)/6435 
P= = (143P, + 182P3 + 88P5 + 16P;)/429 
P» = (3x? — 1)/2 = (33Po + 110P2 + 72P; + 16P5)/231 
Ps = (5x3 — 32) /2 x = (27P; + 28P3 + 8Ps)/63 
Py = (352* — 30x? + 3)/8 a! = (7P + 20P2 + 8P1)/35 
Ps = (63a° — 70x? + 15a)/8 = (3P, + 2P3)/5 
Ps = (231a° — 31527 + 1052? — 5)/16 = (Po + 2P2)/3 
P; = (429a" — 693x° + 31527 — 35x) /16 z= P, 
Ps = (64352° — 120122° + 6930a* — 1260x? + 35)/128 1=P 
To =1 = (35Tp + 567 + 2871 + 875 + Ts) /128 
T=2 x” = (357, + 2173 + 77s + Tr) /64 
To = 2a? -1 a® = (107) + 15T> + 67, + Ts) /32 
T; = 40° — 3a = (107, + 573 + Ts)/16 
Ty = 844 — 8a? +1 x* = (37) + 472 + T1)/8 
Ts = 16x° — 20a? + 5x = (37, + T3)/4 
Ts = 322° — 48a4 + 182? —1 = (T + To) /2 
Ty = 64x" — 1122° + 562° — 7x x=Ti 
Ts = 128a° — 256a° + 1602+ — 32a? +1 1=T 
Uo =1 = (14Up + 28U2 + 20Us + 7U6 + Us) /256 
U, = 2a = (14U; + 14U3 + 6Us + Uz) /128 
Uz = 4a? — 1 = (5Uo + 9U2 + 5U4 + Us) /64 
U3 = 82° — 4x © = (5U, + 4U3 + Us) /32 
Us = 16a4 — 1227 +1 = (2Up + 3U2 + Us)/16 
Us = 32a° — 32x? + 6x = (2U; + Us)/8 
Us = 64a° — 80a* + 24%? — 1 a? = (Uy + U2)/4 





Uz = 1282" — 1922° + 
Us = 256x° — 448r° + 


a= (Ui)/2 
1=Up 


80x? — 8x 
240x2* — 40x? +1 
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6.13.10 ZERNIKE POLYNOMIALS 


The circle polynomials or Zernike polynomials form a complete orthogonal set over 
the interior of the unit circle. They are U?"(r,0) = R?™(r)e’™® where R™(r) are 
radial polynomials, n and m are integers with n — |m| even, and 0 < |m| < n. 


20 
1. Orthogonality | [ou Um(r, 0) ue (r,0) r dr dé = a ae ee 
n+1 


1 
m ms d = Winks 
"Re (r)RM (r) r dr Wn +1) 7 1° 


0 
2. Explicit formula for the radial polynomials 


= ean (ac) _ na a 


s (—1)*(n — s)! nods. (6.13.2) 


=e (4 — 5) (et —s)! 


3. Expansions in Zernike polynomials 








(a) If f(r, @) is a piecewise continuous function then 


=> 3 ArU?" (r, 6) where n — |m| is even. 


n=0m=—n 


1 27 1 
Am = A,” = es | | Um(r, 0) f(r, 0) r dr do. 
wv 0 0 





(b) If f(r, 0) is areal piecewise continuous function then 
0) = S—° S© [Cr cos(md) + $7" sin(mé)] Rr (r) 
n=0 m=0 
1 ifm=0 


2 otherwise. 


On| _ €m(n +1) = m cos(m6) 
ee 7 ats’ | [ P(r, O)Rn aes ne 


where n — |m| is even and €;, = 


or? —1 r? 
6r* — 6r? +1 Ar’ — 3r? r4 
20r® — 30r4 + 12r2 —1 15r° — 20r4 +. 6r? 6r® — 5r* 


1|r 
3 | 3r° — 2r r? 
5 | 10r°— 12r3+3r 5r? —4r? r® 
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6.13.11 SPHERICAL HARMONICS 

The spherical harmonics are defined by 

2+ 1 (l—m)! 
4nr (l+m)! 

for / an integer and m = —/, -1+1,...,1—1, 1. They satisfy 
Yi,-m(9, 9) = (-1)"¥im(@, 4), 


Yio(9, d) = 4/ Fates (6.13.4) 


2141 = \(14 ! 1) +m)/2 imp 1. 7 

T etm id) Lt” integral, 
Y; _ yea = EE 5) 5 
lm 9? ) — 1 
—5* not integral. 


Vata) = ; Pi" (cos #)e"""® (6.13.3) 











The normalization and orthogonality conditions are 


20 Tw 
| de / Sinbad Ha Mao) Sian 
: (6.13.5) 


by 
oO)? 


27 wT 
[40 [sind dO Varma ¥i.ma(8,8)¥igms (8.9), 
0 0 


— {QetHQQs+) fh blh\fh bb 
- My 0 0 


4 (21, + 1) m2 M3 
where the terms on the right-hand side are Clebsch—Gordan coefficients. 
Because of the (distributional) completeness relation, 








co I 
S” So ¥im(9,6)¥im (6, #) = 6(¢ — $')6(cos 6 — cos 6’), (6.13.6) 


l=0 m=-1 


an arbitrary function g(@, é) can be expanded in spherical harmonics as 


oo l 
=> YE Aim¥in(8:8), Am = f Vin F)g(@.8) 40. (6.13.0 
1=0 m=-l 
Some spherical harmonics 
e I = 0 Yoo = = 
e/=1 Y.=- = sin de’? Yio = \/ cos 


el=2 Yoo = 44/32 sin? 6 er? Yo1 = —\/ = sin @ cos 6 e'? 
4$4/(3 cos? @ — 1) 
el=3 Y33 = —F1/ 2 sin® Oe%? — Y39 = 44/4 sin 2 6 cos 6 ce? 
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6.14 CLEBSCH-—GORDAN COEFFICIENTS 


The Clebsch—Gordan coefficients arise in the integration of three spherical harmonic 
functions (see Equation (6.13.5) on page 457). 





(j1 +2 — ING +51 — ja)\G + je — j1)'(29 +1) 








Dek 
m m,m,+mg2 





(§+j1+j2+1)! 





(-1) 8 JG Fama 


ma1)!(j2 + m2)!(j2 — ma)!(7 + m)!(9 — m)! 











kj j i;— kG 
0<k<oo Ga + j2 3 Wa — m4 


1. Conditions: 


k)!(j2 + mo 


kj — jo tmi + k)MG — ja — me +k)! 


(a) Each of {71, j2, 9,71, m2, m} may be an integer, or half an integer. 





(b) ji t+je-—j 20 
(c) ji-—jo+tj 20 
(D ~jo jer 7 0 





(e) 7 > 0,91 > 0,32 > O 


2. Special values: 


(a) @ J2 


my mg, 





m 


(f) 7 + j1 + jo is an integer 
(g) j1 +m, is an integer 
(h) jo + mz is an integer 
(i) |mi| < fa, |ma] < ja, 











ml <j 


:) = 0if my + m2 4m. 


1. Dt ae |. 
ee) a a) = 95,,55mi,m- 


Ji J2}a 
(©) G 0 }0 
hee al) 
(d) e my | mm 





3. Symmetry relations: all of the following are equal to ( owe 


) : 


(c) (apse ( ji J2 


(a) ( a 


m2 —™My 





j 
—m ? 


(b) (—1)91 432-9 GE mn 


my m2 





—mM4 





—mM2 


= 0 when 7; + jo + 7 is an odd integer. 


) = 0 when 27; + 7 is an odd integer. 





JV 
Mm, Mo\)m/)- 





j 
—m ? 





QWtl/_q\jotme( JI Jo} na 
@) Vayqr(-l e mz |—m,)’ 
2j+1 (__4)\ji—mit+j—m | Je a 
©) Vaal @ ae 





2j+1 j- q1- 
(f) a (-1 J-M+jJi—M1 




















2j+1 (__4)\j1—m jt 
(g) Qjo+ ( ie : a 

2j+1 (__4\ji-—m j 
(h) 2jo+ ( a j a 


jo J ya 
mz —m|—m,/)’ 
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ea tes ) may be 


By use of symmetry relations, Clebsch—Gordan coefficients ( ue 
my, mMg|m 





put in the standard form 7; < jg <j andm > 0. 


af | om] mdf Cn ale) 
- m2 

(2 
hy2fa2f—12 fol o[-G)""=-o7om | 
hehe, 12, of Q7= oz | 
hehe, 2[—12[0[ of Gy7= oom | 
hfe, aet—phip of G)"7= ozo | 


Ll [ET *[e ae) — 
[a] a) a1) oat) Gy sori | 
pipet fi ee 
Lp ote eet) = won 
a ea 

1 

ae 





p= ]i] of G)" = oor | 
rbot tap a= orm 


: F , 2 
1 2] m1 | me ] m 
in fae frm fom | fm | (in my me 


Se eee 


Sa aoa ee oe 
Se 


| alm] m| a] mbes mal) | 
ji J2 My m2 m 
My m2 
SAS 6 
SPAR Are 
phat 2 
-—1 





hal of 
rial of 
rat of 4) 
chef of 2 
y 3/ 
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6.15 BESSEL FUNCTIONS 


6.15.1 DIFFERENTIAL EQUATION 
The Bessel differential equation, 
22y” + zy! + (2? —v*)y =0. 
The solutions are denoted with 
J(z), Yv(z) (the ordinary Bessel functions) 


and 
H(z), H(z) (the Hankel functions). 


Further solutions are 
Ia@), Yae, B2@), AC ©. 
When v is an integer, 


n=0,1,2,.... 











=| 





Bessel functions Jo(x), Ji(x), Yo(x), Yi(a), 0 < @ < 12. (FromN. M. Temme, 
Special Functions: An Introduction to the Classical Functions of Mathematical Physics, John 
Wiley & Sons, 1996. Reprinted with permission of John Wiley & Sons, Inc.) 


6.15.2 SINGULAR POINTS 


The Bessel differential equation has a regular singularity at z = O and an irregular 


singularity at z = oo. 
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6.15.3 RELATIONSHIPS 
H(z) = I(z)+i¥(z), H(z) = I(z)- iY (2). 
Neumann function: If v # 0,+1,+2,... 
cosuvm J,(z) — J_,(z) 
sin vt 


When v = n (integer) then the limit 7 — n should be taken in the right-hand side of 
this equation. Complete solutions to Bessel’s equation may be written as 














Y,(z) = 


cid) (z) + eJ_r(z), if v is not an integer, 
cJ)(z) + c2Y,(z), for any value of v, 
oH (z) + eH?) (2), for any value of v. 





6.15.4 SERIES EXPANSIONS 


For any complex z, 


(yr (hay 








= 1,\y 
Te) AG?) Lo Te+y 4 ial 
1 1 
Jo(z) = 1— (52) + sa (92)" — G2 te 
1 1 i 1 
1,\—n n-1 
Yr(z) = = Jn(e)In(3 2) — ae) ara Ula 2) 
k=0 
(bn = (<1)(b 2)? 
z Dd Wk+D +R +k+ YI 


k=0 


where w is the logarithmic derivative of the gamma function. 


6.15.5 RECURRENCE RELATIONSHIPS 





Ca(2) + Gvsa(2) = 2C,(2), 
Cy—1(z) — Cy4i(z) = 2C, (2), 
Ch(2) = Cy-1(2) — <Cv(2), 
Ch(2) = —Cr4a(2) + 5O,(2), 


where C,(z) denotes one of the functions J,(z), YL(z), HY (2), HY? (z). 
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6.15.6 BEHAVIOR AS z > 0 


Let Re v > 0, then 


Il2) a. ¥,(2) ~ 22) (2). 
H(2)~ 200) (2), HP @) ~-Sre (2) 


The same relations hold as Re v — ov, with z fixed. 


6.15.7 INTEGRAL REPRESENTATIONS 


Let Re z > 0 and v be any complex number. 





1 Tv * co : 
J)(z) =— | cos(v@ — zsin 0) dd — = | get rams ay 
T JO a 0 


2) 7 pat 
= a (1 - t?) * cosztdt, Rev> —t, z complex, z 4 0, 


Val(y + 3) -1 
2 (ia) a sin xt 
a ——~ dt, xz >0, |Rev| < -, 
Jal (5 —¥) Ji (42 —1)"*? : 


T 


1 /[* on . 
Y,(z) S— | sin(z sin — V0) dé — / te +e”* cos vt) eo zsinht gp 
” 0 


2(4a) ” [ cos xt 
Sy eh ie ee 
Val (3—v) sy (42 —1)"4? . 


When v = n (an integer), the second integral in the first relation disappears. 


6.15.8 FOURIER EXPANSION 


For any complex z, 


co 
eo iz sint = S- ew int 7 (z) 
n=—oo 
with Parseval relation 
lee) 
S- ike) ee 
n=—oo 


6.15.9 AUXILIARY FUNCTIONS 
Let y = z— ($v + 4)7 and define 


P(v,z) = V1z/2| Jp(z)cosx + Y_(z) sin x], 
Q(y, z) = V 4z/2[-JL(z) 


sin y + Y_(z) cos x]. 
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6.15.10 INVERSE RELATIONSHIPS 


(z) = V2/(nz) [P(v, z) cos x — Q(v, z) sin x], 
(z) aw) (Plu, z)siny + Q(y, z) cos x]. 


For the Hankel functions, 


The functions P(v, z), ie 7 are the slowly varying components in the asymptotic 
expansions of the oscillatory Bessel and Hankel functions. 


6.15.11 ASYMPTOTIC EXPANSIONS 
Let (a, ) be defined by 


{ (4a? — 1)(4a? — 37)--- (4a? — (2n — 1)")} 





with recursion 








(a,n+1)=—- ai | (a,n), n=1,2,3,..., (a,0) = 
Then, for z + oo 
= n (Y, 2) — n(¥,2n + 1) 
Pua DAN) Qa>’ ous 2 CN “zp 
With ps = 4v 
(u—1)(H—9) | U—1)(H— 9)(u — 25) (u — 49) 
BNE) el aaa ————abieaye 
M-1_ (u—1)(u—9)(u— 25) 
Q(v,z) ~ Re ~— gigas =. 


For large positive values of x, 
1 1 
J(x) = \/2/(r2x) cos(a = Se a” + ow) , 


Yi —./s7Ge sin(e - sun in) +0G-)| 
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6.15.12 ZEROS OF BESSEL FUNCTIONS 


For v > 0, the zeros j,,, (and yy.) of J,(a) (and Y,(x)) can be arranged as se- 
quences 


0 < gua <gu2<-0+<jJun<-++, lim Jun =~, 
noo 

0 < Yn <W2<99<Yn<c,) lim Wn =~. 
noo 


Between two consecutive positive zeros of J,,(a), there is exactly one zero of 
Jv41(x). Conversely, between two consecutive positive zeros of J,+41(x), there is 
exactly one zero of J,(x). The same holds for the zeros of Y,(z). Moreover, be- 
tween each pair of consecutive positive zeros of J,,(a), there is exactly one zero of 
Y,(a), and conversely. 


6.15.12.1  Asymptotics of the zeros 
When v is fixed, s >> v, and pp = 4v”, 


420 1 L- A(7u? — 31) _ 32(83u? — 982 + 3779) 
wee Ba 3(8a)? 15(8a)4 

where a = (5 + sy - t)n; Yv,s has the same asymptotic expansion with a = 

(s+ gv — 4)r. 


2.40483 | 3.83171] 0.89358] 2.19714 
5.92008 | 7.01559 | 3.95768] 5.42968 
8.65373 | 10.17347 | 7.08605} 8.59601 


11.79153 | 13.32369 | 10.22235 | 11.74915 
14.93092 | 16.47063 | 13.36110 | 14.89744 
18.07106 | 19.61586 | 16.50092 | 18.04340 
21.21164 | 22.76008 | 19.64131 | 21.18807 


Positive zeros jun, Yv»n Of Bessel functions J, (a), Y)(x), v = 0,1. 





6.15.13 HALF ORDER BESSEL FUNCTIONS 


For integer values of n, let 
In) =V m/(2z) Insa (2), Un(2) =V m/(2z) Yn+4 (2). 
. sin z . COS Z 
Jo(z) = y-1(2) = =, woz) = —J-1(z) = -—_, 
and, forn = 0,1,2,..., 


inte) = (-2)" [PE] 2 yale) =-(-2)" [2S] 


z 


Then 
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e Recursion relationships: The functions j,,(z), Yn(z) both satisfy 


2|fn—1(2) + fn4i(z)] = (2n + 1)fn(z), 
Nfn—1(z) — (n+ 1) fn4i(z) = (2n + 1) fr(z). 


e Differential equation 


z°f" + 2zf' + [22 —n(n+1)]f =0. 


6.15.14 MODIFIED BESSEL FUNCTIONS 


1. Differential equation 


2. Solutions I, (z), K,(z), 


we)= (5) Urpee ra 


n=0 
K,(z) mw I_,(z) — I(z) 
AZ) = > 
2 sin v7 


where the right-hand side should be determined by I’ H6pital’s rule when v 
assumes integer values. When n = 0,1, 2,..., 


K,(z) =(-)"*1In(2) In 5 +5 (2)"s oe (-2)' 


z 





k=0 

ely ey = (2/2)"* 
= k+1 k + 1)|—1+_.. 
aa DIM ga eae ear 

3. Relations with the ordinary Bessel functions 
I,(z) = e327, (ze?™) —m <argz< > 
Liner hy (ze in) ; —<argz<7, 
K,(z) = Sie ™ Hi) (ze8™) —m <argz< > 
Ky(z) = Fie HP) (ze-4**) ; -+ <argz <7, 
sri 4(v4+1)ri 2 —tyri T 
¥,(ze4 ) =e? IL(z) — —e"?"™" K,(z), —t <argz< 3" 
1 


Forn = 0,1,2,..., 
2 
iar), Vie" Lie eK), 
1 


I_y(z)=TIn(z), K_v(z)= Ki(z), foranyv. 
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4. Recursion relationships 





Iyua(2) — Loaae) = 252), Keaa(2)— Kv-ale) = 2K) 
T-a(z)+Iv4i(2)=20(2), — Ku-a(z) + Kuga(z) = -2K1(2) 


5. Integral Representations 


1,(z) = ~[ e789 cos(v) dé — me e vt— zcosh t dt 
0 Tv 0 


= (2z)"e* ; e 2%t - v-s 
=D | [e(1 — t))"-2 dt, 


Rev > —4, z complex, z ¥ 0. 


DE] 


2\" 2 oo 
Tis 1 
= Va (3 | en 2ztey z(t+ if-2 dt, 
0 
Rev > —3, Rez > 0, 


Kea T (v + $) (22)” . cos xt dt 
. 7 NV AIe i 0 (42 4 22)"42 


1 
Rev > 3 


"9 
a> 0, jargz| < $7. 


When vy = n (an integer), the second integral in the first relation disappears. 


6.15.15 AIRY FUNCTIONS 























1. Differential equation: y” — zy =0. 
2. Solutions are Ai(z) and Bi(z): 
Ai(z) = ci f(z) — c2g(z), 
Bi(z) = V3 [er f(z) + c2g(2)] 
ae 1 1-4 1-4-7 
= 3 6 9 
f(z) =1+ gy? ta? tor? +..., 
= 4 Beg Bown Dab ete 
LO aca ae ae (ei 
Bi(0) _ 3-2/3 
c= aio) = BO) _ 37” — 0.3550280538 87817, 
V3 (3) 
Bi (0) 3-7" 
esau. — = 0.25881 94037 92807 . 
v3 «T(3) 
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FIGURE 6.6 

Graphs of the Airy functions Ai(x) and Bi(a), x real. (From N. M. Temme, Special Func- 
tions: An Introduction to the Classical Functions of Mathematical Physics, John Wiley & 
Sons, 1996. Reprinted with permission of John Wiley & Sons, Inc.) 


Bi(x) 








NARA 


=[E 





4. Relations with the Bessel functions: Let ¢ = 293, then 
1 1 
Ail) = gv7 [Ly - 0] = 2YEKy0. 
1 
Ai(-z) = svz[46) + 140) 





5. Asymptotic behavior: Let ¢ = 223. Then, for z > 00, 
Ai(z) = sage tes [1+0(C)], arg2| <7, 
Bi(2) = arte [1 40()], arg z| < ba, 
Ai(—z) = 27} [sin (C+ 49) +0(C)], arg | < 2a, 
Bi(-2)=-az-4 [oos(¢+ 4x) +O(C)], Large < 3. 








cos ($3 + at) dt, 


1 ia 
Biz) =— | e~ 3° + ge + ~ | sin ($¢? + at) dt. 
TT T Jo 
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1.00000000 
0.82693855 
0.69740217 
0.59932720 
0.52414894 
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ily — 
0.99002497 
0.96039823 
0.91200486 
0.84628735 


0.76519769 
0.67113274 
0.56685512 
0.45540217 
0.33998641 


0.22389078 
0.11036227 
0.00250768 
—0.09680495 
—0.18503603 


—0.26005195 
—0.39714981 
—0.17759677 


0.46575961 
0.41978208 
0.38306252 
0.35331500 
0.32887195 


0.30850832 
0.29131733 
0.27662232 
0.26391400 
0.25280553 


0.24300035 
0.20700192 
0.18354081 


0. — 
0.09950083 
0.19602658 
0.286 70099 
0.36884205 


0.44005059 
0.49828906 
0.54194771 
0.56989594 
0.58151695 


0.57672481 
0.55596305 
0.52018527 
0.47081827 
0.40970925 


0.33905896 
—0.06604333 
—0.32757914 


914075732 
1.66268209 
1.41673762 
1.25820312 


1.14446308 
1.05748453 
0.98807000 
0.93094598 
0.88283353 


0.84156822 
0.80565398 
0.77401814 
0.74586824 
0.72060413 


0.69776160 
0.60929767 
0.54780756 


- 10811 10532 
—0.60602457 
—0.30850987 
—0.08680228 


0.08825696 
0.22808350 
0.33789513 
0.42042690 
0.47743171 


0.51037567 
0.52078429 
0.51041475 
0.48133059 
0.43591599 


0.37685001 
—0.01694074 
—0.30851763 
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_3.39380499 
—1.78087204 
—1.26039135 
—0.97814418 


—0.78121282 
—0.62113638 
—0.47914697 
—0.34757801 
—0.22366487 


—0.10703243 
0.00148779 
0.10048894 
0.18836354 
0.26354539 


0.32467442 
0.39792571 
0.14786314 


0. — 
0.08228312 
0.13676322 
0.17216442 
0.19449869 


0.20791042 
0.21525686 
0.21850759 
0.21901949 
0.21772628 


0.21526929 
0.21208773 
0.20848109 
0.20465225 
0.20073741 


0.19682671 
0.17875084 
0.16397227 


5.83338603 
3.25867388 
2.37392004 
1.91793030 


1.63615349 
1.44289755 
1.30105374 
1.19186757 
1.10480537 


1.03347685 
0.97377017 
0.92291367 
0.87896728 
0.84053006 


0.80656348 
0.68157595 
0.60027386 
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6.16 BETA FUNCTION 


1 
B(p, q) = t?-'(1—t)*" "dt, Rep>0, Req>0. (6.16.1) 
0 
1. Relations: 
q q 
B(p,q) = Ba, p), B(p,q+1) == B(p+1,q) = —— B(p,q). 
(p,q) = B(q,p) ( ) ; ( ) Par ( 
2. Relation with the gamma function: 
P(p) Tq) Pip) Pg P(r) 
Bip, q) = =—; Bip, gq) Bip + 4,7) = —=———- 
9) T'(p+4q) tpg) BK ) Tip+¢q+r) 


3. Other integrals: (in all cases Re p > 0 and Re q > 0) 


m/2 
B(p,q) = 2 | sin??—! @ cos??-1 6 dO 
0 


a pp-1 a q-1 
_ [7 Sica [ene 
o (&+1)Pt9 0 


1 —1 —1 
ple — 8) 
— fF Pp 
are i (r + t)P+4 oS ae 


6.16.1 NUMERICAL VALUES OF THE BETA FUNCTION 
fo [a= 0.100 Wa 0300 TAO O00_ 600 W080 OF T000 


11. 333 10. 914 10. 607 10. 365 10. 166 10. 000 
6.269 5.872 5.576 5.345 5.157 5.000 
4.554 4.169 3.883 3.661 3.482 3.333 
3.679 3.303 3.027 2.813 2.641 2.500 
3.142 2.775 2.506 2.299 2.135 2.000 
2.775 2.415 2.154 1.954 1.796 1.667 
2.506 2.154 1.899 1.705 1.552 1.429 
2.299 1.954 1.705 1.517 1.369 1.250 
2.135 1.796 1.552 1.369 1.226 1.111 
2.000 1.667 1.429 1.250 1.111 1.000 
1.791 1.468 1.239 1.069 0.938 0.833 
1.635 1.321 1.101 0.938 0.813 0.714 
1.513 1.208 0.994 0.837 0.718 0.625 
1.415 1.117 0.909 0.758 0.644 0.556 
1.333 1.042 0.840 0.694 0.585 0.500 
1.264 0.979 0.783 0.641 0.536 0.455 
1.205 0.925 0.734 0.597 0.495 0.417 
1.153. 0.878 0.692 0.558 0.460 0.385 
1.107 0.837 0.655 0.525 0.430 0.357 
1.067 0.801 0.622 0.496 0.403 0.333 
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6.17 ELLIPTIC INTEGRALS 


Any integral of the type [ R(x,y) dx, where R(x, y) is a rational function of x 
and y, with y? being a polynomial of the third or fourth degree in x (that is y? = 
agx* + ax? + agx? + agx + a4 with |ao| + |a1| > 0) is called an elliptic integral. 
All elliptic integrals can be reduced to three basic types: 


1. Elliptic integral of the first kind 


ron)= [ sl 
—— ek ok 


-| SS , g=sing, k? <1. 
JO — 2) — kt) 
2. Elliptic integral of the second kind 
? 
k) = i. V1—k? sin? 6 do 
-[ V1 — ket? 


1- “Vl 
3. Elliptic integral of the third kind 


H(n; 6, k) - : ut 
n: = ee 
a o 1+nsin? 6 \/] —k2 sin? 


= 1 
=| ——_______, g=sind, F <1. 
| 1+ nt? \/1—®)0 — P22) : 


where for n < —1 the integral should be interpreted as a Cauchy principal 
value integral. 


dt, xc=sing, k? <1. 





6.17.1. COMPLETE ELLIPTIC INTEGRALS 


1. The complete elliptic integrals of the first and second kinds are 


n/2 z 11 
K =K(k) =F (4k) a (1—k? sin? t) 7? dt = TF ( =, =51; 4? 
2 A 2° \92? 
m/2 ; 1/2 
K(a) =), (1 — sin? asin? t) dt, 
0 
n/2 
wa = Ly _ Qo 24\l/2 4, 7 It 432 
B =E(k) = (5k) -/ (1— k sin? t)”” dt = aF (5.58 


n/2 2. 9,\1/2 
E(a) = (1 —sin* asin? t)’~ dt, 
0 





where F’ (+5, 5 531; oe) is the Gauss hypergeometric function. 
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2. Complementary integrals 


In these expressions, primes do not mean derivatives. k is called the modulus, 
k! = V1 — k? is called the complementary modulus. 








nm /2 
K! = K'(k) = K(k’) | (1- (1) sin?t)-"/? dt = F(Z, h'), 
0 








m/2 
E! = E'(k) = E(k’) | (1—(1— #2) sin? t)'”? dt = B (<, K’) 
0 


3. The Legendre relation is, 





KE'+EK'-KK’'= > 
4. Extension of the range of ¢ 
F(n,k) = 2K, E(x,k) = 2E, 
and, form = 0,1,2,..., 


F(¢é+mr,k) = mF (r,k) + F(¢,k) = 2mK + F(¢,k), 
E(¢+ma,k) =mE(r,k) + E(¢,k) = 2mE 4+ E(d,k). 














Kk 
20°F 
W2E 
E(k) 
1.0 F 
0:5: |F 
0 i 1 k> i 
0.5 1.0 





The complete elliptic integrals E(k) and K(k),0 < k < 1. (FromN. M. Temme, 
Special Functions: An Introduction to the Classical Functions of Mathematical Physics, John 
Wiley & Sons, 1996. Reprinted with permission of John Wiley & Sons, Inc.) 
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6.17.2 NUMERICAL VALUES OF THE ELLIPTIC INTEGRALS 


¢ = 
F(¢,a) = / (1- sin” asin? t) 2 att (note that k = sin a) 


0 


0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 
0.1746 0.1748 0.1749 0.1751 0.1752 0.1753 
0.3499 0.3508 0.3520 0.3533 0.3545 0.3555 
0.5263 0.5294 0.5334 0.5379 0.5422 0.5459 
0.7043 0.7116 0.7213 0.7323 0.7436 0.7535 
0.8842 0.8982 0.9173 0.9401 0.9647 0.9876 
1.0660 1.0896 1.1226 1.1643 1.2126 1.2619 
1.2495 1.2853 1.3372 1.4068 1.4944 1.5959 
1.4344 1.4846 1.5597 1.6660 1.8125 2.0119 
1.6200 1.6858 1.7868 1.9356 2.1565 2.5046 


0.0000 0.0000 0.0000 0.0000 0.0000 
0.1744 0.1743 0.1742 0.1740 0.1739 
0.3483 0.3473 0.3462 0.3450 0.3438 
0.5209 0.5179 0.5141 0.5100 0.5061 
0.6921 0.6851 0.6763 0.6667 0.6575 
0.8614 0.8483 0.8317 0.8134 0.7954 
1.0290 1.0076 0.9801 0.9493 0.9184 
1.1949 1.1632 1.1221 1.0750 1.0266 
1.3597 1.3161 1.2590 1.1926 1.1225 
1.5238 1.4675 1.3931 1.3055 1.2111 


K(k) |R'(k) E(k) E(k) 
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6.18 JACOBIAN ELLIPTIC FUNCTIONS 


The Jacobian Elliptic functions are the inverses of elliptic integrals. If u = F'(@, k) 
(the elliptic integral of the first kind) 


¢ sind 
u= | —— - | Sn (6.18.1) 
0 V1—Kk?sin?9 Jo (1 — t2)(1 — k2#?) 
with k? < 1, then the inverse function is 
g=amu (the amplitude of wu). (6.18.2) 


(Note that the parameter / is not always explicitly written.) The Jacobian elliptic 
functions are then defined as 


1. snu = sn(u,k) = sing = sin(am wu) 
2. cnu = cn(u,k) = cos¢ = cos(amu) = V1 — sn? u 
3. dnu = dn(u,k) = V1— k? sin? 6 = V1 — k2 sn? u 


Note that 
dt dn(u,k) dt 
= Me aarrr Geer | | a aaa See: 
1 /(1 — t2)(k’? + kt?) 1 /(1 — t2)(t? — k’?) 
(6.18.3) 
6.18.1 PROPERTIES 
1. Relationships 
sn?(u,k) + en?(u, k) = 1, 
dn?(u, k) + k? sn?(u, k) = 1, 
dn?(u, k) — k? en?(u,k) =1—k? =k”. 
2. Special values 
(a) sn(0,k) = 0, (e) sn(u,0) = sin u, (h) sn(u,1) = tanh u, 
(b) cn(0,k) = 1, (f) cn(u,0) = cosu, (i) cn(u, 1) = sechu, 
(c) dn(0,k) = 1, (g) dn(u,0) = 1, (j) dn(w, 1) = sech wv. 


(d) am(0,k) =0, 


3. Symmetry properties 


(a) sn(—u) = —sn(u), (c) dn(—u) = dn(w), 


(b) cn(—u) = cn(u), (d) am(—wu) = —am(u). 
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4. Addition formulas 
(ae ant snucnudnv+cnusnvdnu 
a) SH(UT UV) = 
1—k? sn? usn2 uv 
cnucnv + snudnusnvdnv 
(b) cn(u a v) => . Wo. @2e.05 00, 8 
1—k* sn? usn*v 
dnudnv +k? snucnusnvcnv 


(c) dn(w+v) = 





> 














1 —k? sn? usn? v 

5. The elliptic functions are doubly periodic functions with respect to the vari- 
able u. The periods of 

sn(u,k) are 4K and 2iK’, 

cn(u,k) are 4K and 2K +2iK’, 

dn(u,k) are 2K and 4iK’. 


6.18.2 DERIVATIVES AND INTEGRALS 


d 1 

1. —snu=cnudnu. 4. J svudu == (anu kenw), 
dy k 

2. Gq on =~ snudnu. 5: enudu= = cos~1(dnu). 
d 

3. 7, nu = —k’ cnusnu. 6. jf erudu = amu = sin“ (on). 


6.18.3 SERIES EXPANSIONS 
u> 
Br 


3 
sn(u,k) = u—(1+ Ke) + (1+ 14k? + k*)S 





7 
— (1+ 135k? + 135K4 + KS) Pcs 











2 4 6 (6.18.4) 
u 9, U 5 aU 
cn(u, k) =1-5 + (1+ 4k )qy 7 (1 + 44k + 16k ep tere 
: ud , ae 
dn(u,k) =1— a +k (44 we) — k?(16 + 44k? + ar +.... 
Let the nome q be defined by q = e~7*/*" and v = nu/(2K). Then 
9 Send n+4 
sn(u,k) = ce yi ere sin[(2n + 1)v], 
Die grtz 
cn(u, k) = ke dX T+ gn cos|(2n ai id 1)v], (6.18.5) 
7 or q” 
dn(u, k) = +— cos(2nv). 
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6.19 ERROR FUNCTIONS 


2 are: 
erf x = — i e* dt, 
Va Jo 

2 we) ye 
erfex = Wr . e? 


The function erf x is known as the error function. The function erfc x is known as 
the complementary error function. 


6.19.1 PROPERTIES 
1. Relationships: 
erfx+erfcex = 1, erf(—2x) = —erf a, erfc(—x) = 2 —erfex. 


2. Relationship with normal probability function: 
= —-—er ae . 
V Jon 2 J2 


6.19.2 ERROR FUNCTION OF SPECIAL VALUES 


erf(too) = +1, erfc(—co) =2, erfcoo =0, 














1 
erf xp = erfc xo = 3 if x9 ~ 0.476936. 


6.19.3 EXPANSIONS 


1. Series expansions: 


ed =a ie ee 8 poy bee _ iat 
Vio 8 a Oy. ate Yee 


(3) a 2n+1 —x? 5 
=e 32 CESSES =o a - + — fe 
a? “ (n 3) xv Vi~ ax 3 x Wb 


2. Asymptotic expansion: For z > oo, 





erfe z ~ —= 


2 e* ne ae: 15 
mT Qz 222 Az4 878 "} 





2 e-2 & (-1)" (2n)! 
+ )” (2n) 
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6.19.4 SPECIAL CASES 


. 1 
1. Dawson’s integral F(a) = e i e’ dt= 5 ivme® erf (iz). 
0 
2. Plasma dispersion function 





i ye ee 
w(z) = ae erfc(—iz) = =| . dt, Imz>0 
z 





6.20 FRESNEL INTEGRALS 


2. f% 2 [* 
-\=/ cos t” dt, si= = | sin t? dt. 
T Jo T Jo 


6.20.1 PROPERTIES 








1. Relations: C(z) +iS(z) = : - erf 35 
2. Limits: jim C(z) = > jim, S(z) = 5 
3. Representations: 
Cle) = 5 + £(2) sin(2?) — 9(2) cos(2”) 
S(2)= 7 — f(2) cos(2?) — g(2) sin(2”) 
where Jie~?” e 


z) dt, = 

A -—3[° Wasa g(2 =f (t2 +1) 

4. The figure below showing Cornu’s spiral (also called an Euler spiral) is given 
by « = C(t) and y = S(t) fort > 0. (Figure from N. M. Temme, Special 
Functions: An Introduction to the Classical Functions of Mathematical Physics, John 
Wiley & Sons, 1996. Reprinted with permission of John Wiley & Sons, Inc.) 


(0.5,0.5) @c2'] 
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6.20.2 ASYMPTOTIC EXPANSION 


And for z + oo, |argz| < 


1 
37 


jie) oye 


6.20.3 NUMERICAL VALUES OF ERROR FUNCTIONS AND 


1 S(—pn bent 9/2) 


In+1/2 





yan+3/2 


FRESNEL INTEGRALS 


0. ane 
0.22270259 
0.42839236 
0.60385609 
0.74210096 
0.84270079 
0.91031398 
0.95228512 
0.97634838 
0.98909050 
0.99532227 
0.99813715 
0.99931149 
0.99976397 
0.99992499 


0.99997791 
0.99999397 
0.99999848 
0.99999964 
0.99999992 
0.99999998 
1.00000000 
1.00000000 
1.00000000 
1.00000000 


1.00000000 


; aaa 
0.80901952 
0.67078779 
0.56780472 
0.48910059 
0.42758358 
0.37853742 
0.33874354 
0.380595299 
0.27856010 
0.25539568 
0.23559296 
0.21849873 
0.20361325 
0.19054888 


0.17900115 
0.16872810 
0.15953536 
0.15126530 
0.14378884 
0.13699946 
0.13080849 
0.12514166 
0.11993626 
0.11513908 


0.11070464 





1 
 Q2/2rz | 7 


0. a9 
0.15955138 
0.31833776 
0.47256350 
0.61265370 
0.72170592 
0.77709532 
0.75781398 
0.65866707 
0.50694827 
0.36819298 
0.32253723 
0.40704642 
0.55998756 
0.64079292 


0.56080398 
0.41390216 
0.39874249 
0.53845493 
0.60092662 
0.47431072 
0.41041217 
0.54218734 
0.56533023 
0.42894668 


0.48787989 


1 | 3 105 


21z 


“Tn” Te 
15 945 
422 1624 


0. son 
0.00212745 
0.01699044 
0.05691807 
0.13223984 
0.24755829 
0.39584313 
0.55244498 
0.67442706 
0.71289443 
0.64211874 
0.49407286 
0.36532279 
0.36073841 
0.48940140 


0.61721360 
0.58920847 
0.44174492 
0.39648758 
0.52778933 
0.59612656 
0.46899697 
0.41991084 
0.55685845 
0.54293254 


0.42121705 
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-... 
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6.21 GAMMA FUNCTION 


re) = f Pole td: gent, o> 0. 
0 


6.21.1 RECURSION FORMULA 
T(z4+1) =2T(z). 


The relation T(z) = ['(z+ 1)/z can be used to define the gamma function in the left 
half plane with z not equal to a non-positive integer (i.e., z A 0,1, —2,...). 


6.21.2 GAMMA FUNCTION OF SPECIAL VALUES 
T(in+1)=n! ifn =0,1,2,...,where 0! = 1, 
ra)=1, T@=1, 13)=2, Ta)=v7, 


P (m4 5) =e va m=1,2,3,..., 


P(-m+5) = va 1M = 1,253) 0 os 





1) 
T (4) = 3.62560 99082, T(3 
T (4) = Ve =1.7724538509, (2 
V (3) = 1.22541 67024, rs 


6.21.3. PROPERTIES 


1. Singular points: | The gamma function has simple poles at z = —n, (for 
n =0,1,2,...), with the respective residues (—1)”/n!; that is, 
(-1)” 





lim (z+ n)[(z) = 


zn n! 


2. Definition by products: 


n! n? 


= ae ele 
ss 
T(z) 


3. Other integrals: 


Co 
= ze?” i la + z/n)e~7/"|, + is Euler’s constant. 


n=1 


T(z) cos =} t?—' cost dt, 0<Rez<1l, 
0 


co 
T(z) sin -| #-! sintdt, -—1<Rez< 1. 
0 
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FIGURE 6.7 
Graphs of V(x) and 1/T() for x real. (From N. M. Temme, Special Functions: An Introduc- 


tion to the Classical Functions of Mathematical Physics, John Wiley & Sons, 1996. Reprinted 
with permission of John Wiley & Sons, Inc.) 

















A 
a 
aL 
1 B a 
al 
2 T(x):: 
oh 
| WT) : 
4. Derivative at x = 1: I’(1) = | Inte‘ dt = —y 
0 
1 
5. Multiplication formula: T(2z) = 17/2 272-1 1P(z) TL (2 + 5) 
6. Reflection formulas: i 
T(z) Tz) = ri Pia) = 
Vie e sin 72’ (a +2) 0G —2) cos 12’ 


= eae Ta-z) _ (—* 5 
I'(z—n) =(-1) ete) ~ sinmzP(n+1—2) 


6.21.4 ASYMPTOTIC EXPANSION 


For z — oo, | arg z| <7: 


On 1 1 139 
1 ge ee ee ca ad eee 
(2) Zz © | loz) 8 Slew 


[Qn , “Bon i (6.21.1) 
if T ~ | =< z z edfit. pe Sa Ree . . 
et ( eo Dy 2n(2n — 1) z2n-1 


n=1 


eee a ok 
~ In —2z%e ae 
2 12z 360z2 126025 168027 : 


where B,, are the Bernoulli numbers. If we let z = n a large positive integer, then a 
useful approximation for n! is given by Stirling’s formula, 








T(nt+l)=nl~ V2ann"e"", no. (6.21.2) 
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6.21.5 LOGARITHMIC DERIVATIVE OF THE GAMMA FUNCTION 
1. Definition (for z 4 0,—1,—2,...): 








we) = 4nt) =-7+ (+-=). 


n=0 








2. Special values: w(l)=-y7, ¥(§) =-y-2m2 
3. Asymptotic expansion: For z + oo, | arg 2| < 7: 
1 GQ Bon 
a 
a az £4 2nz2” 
1 1 1 
~lnz-— 


a2. 1222 12004 252281 


6.21.6 NUMERICAL VALUES OF GAMMA FUNCTION 


1.00000000 | = 0.00000000 | —0.57721566 | 1.64493407 
0.97843820 | —0.02179765 | —0.51327488 | 1.55371164 
0.95972531 | —0.04110817 | —0.45279934 | 1.47145216 
0.94359019 | —0.05806333 | —0.39545533 | 1.39695222 
0.92980307 | —0.07278247 | —0.34095315 | 1.32920818 


0.91816874 | —0.08537409 | —0.28903990 | 1.26737721 
0.90852106 | —0.09593721 | —0.23949368 | 1.21074707 
0.90071848 | —0.10456253 | —0.19211890 | 1.15871230 
0.89464046 | —0.11133336 | —0.14674236 | 1.11075532 


0.89018453 | —0.11632650 | —0.10321006 | 1.06643142 


0.88726382 | —0.11961291 | —0.06138454 | 1.02535659 
0.88580506 | —0.12125837 | —0.02114267 | 0.98719773 
0.88574696 | —0.12132396 | 0.01762627 | 0.95166466 
0.88703878 | —0.11986657 |} 0.05502211 | 0.91850353 
0.88963920 | —0.11693929} 0.09113519 | 0.88749142 


0.89351535 | —0.11259177} 0.12604745 | 0.85843189 
0.93138377 | —0.07108387] 0.28499143 | 0.73697414 
1.00000000 | 0.00000000 | 0.42278434 | 0.64493407 
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6.22 HYPERGEOMETRIC FUNCTIONS 


Recall the geometric series and binomial expansion (|z| < 1), 


(l-z)1= 3 ee (l-z)*= 5 (“") (-z)" = 3 @n an 


n=0 n=0 


where the shifted factorial, (a),,, is defined in Section 1.3.4. 
The Gauss hypergeometric function, F’, is defined by: 


F (a,6;¢;2z) = > (@)n (6)n ()n Zz” 


om (c)n n! 

b 1)b(b+1 (6.22.1) 
yp, OE ow lz| <1, 

c c(c + 1) 2! 
= F'(b, a;c; z) 


where a, b and c may all assume complex values, c £ 0, —1, —2,.... 


6.22.1 SPECIAL CASES 
1. F'(a,b;b;z) = (1—2z)% 
2. F(1,1;2;z)= cae) 


z 
a 1 l+z 
3 P (Sug?) = pn (*) 











, z 
2 
6 ets. a _ Ing+vl+2*) 
2°2'2 Zz 
7. Polynomial case; form = 0,1,2,... 


F (=m, bje;2) = Yn On am = (ay (™) On 2m (6.22.2) 


(c)n n! 





n=0 


6.22.2 PROPERTIES 


1. Derivatives: 


d ab 
gy a baz) = Flat lb+iet hz), 
d” n(b)n 
Sie On wr hoenaey. 


C)n 
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2. Special values; when Re (c — a — b) > 0: 


T(c)' (ce —a—b) 
F ;¢ 1) = =... 
hey T(c—a)P(c— 6) 

3. Integral; when Re c > Reb > 0: 


(ec) Yaad ee 7 
Totoy f ota = ya 


4. Functional relationships: 


F(a,b;¢;z) = 


F(a, }; ¢;z) = (1— z) °F (a,c— bc; : 
z 


ee, 
z 
= (1— 2) °F (e— a,b; c; — 
(1-2) F(e- a,b: —) 
= (1—2)* *"F(c—a,c—b;e 2). 
5. Differential equation: 


z(1—z)F" + [(c— (a+b+1)z|F’ —abF =0, 


with (regular) singular points z = 0, 1, oo. (See page 408 for singular points.) 


6.22.3 RECURSION FORMULAS 


Notation: F’ is F (a, b;c; z); F(a+), F(a—) are F (a+ 1,0; cz), 
F (a—1,b;c; z), respectively, etc. 





1. (c—a)F(a—) + (Qa—c—az+bz)F + a(z—1)F(at+ 





2. e(c—1)(z—-1)F (c—)+cl[c—1-(2c—a—b—-1)z] F+(c—a)(c—b)zF (c+) =0 
3. cla+ (b—c)z|F — ac(1 — z)F(a+) + (c— a)(c— b)zF (c+) =0 








b—a)F + aF (a+) — bF'(b+) =0 














( 
(c—a—b)F+a(1— z)F(a+) — (c— b6)F(b-) =0 
( 
( 


b—a)(1— z)F — (c—a)F(a—) + (c— b)F(b-) =0 
9. [a—14+ (}+1-c)z|F + (c— a)F(a—) — (c—1)(1—- z)F(c—) =0 





6.23 LAMBERT FUNCTION 





Lambert’s W (x) function is defined implicitly by 


WeV =x 


6.23. LAMBERT FUNCTION 








When x € [0,00] there is one real solution 
W(x); it is nonnegative and increasing. When 


rE (—4, 0) there are two real solutions, one in- 
creasing and one decreasing. 


6.23.1 PROPERTIES 


1. Numerical Values 

















(a) W (-e"*) =-1 
(b) W(0)=0 W’'(0)=1 


2. Representations 


(c) W(1) = 0.567143... 
(d) W(e)=1 
De ae 2,3 3 84 
Cao» i a + 92 — 3% +... 
(b) Asa oo wehave W(x) ~ Inzg—Inlng+ 4B +... 
(c) Asx — 07 wehave W(x) ~ —In(—4 
3. Solving equations 





+) —InIn (—3) 
” (104 + Ba) + Ca = inD) (: = bw (S2e40/8) — 4) 
(b) Cag =crt+ a) es (« = _w( ainp yb—ad/c) 
(c) (« :) 


_ 4) 
alnp c 
(« Inz ) 
(@) x ttoo= a" 


In In(—+) 


In —1) 7 











= Wins) when the power tower converges 
4. Differential equation and integrals 
dW 1 
(a) ‘dx xr+ew 
(b) / 


W (a) dx = 2(W(x) -—1) +e" +0 


(c) [ Wear=e-1 (d) [ Wie) 
0 0 


ze 





dx = 2/27 
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6.24 LEGENDRE FUNCTIONS 


6.24.1. DIFFERENTIAL EQUATION 


The Legendre differential equation is 





(1 — 27)w" — 2zw’ + v(v +1)w = 0. (6.24.1) 


The solutions P,(z),@Q_(z) can be written in terms of Gaussian hypergeometric 
functions: 


1 eb 
Pile) =F (-ny 4 tii — 52), 
1 1 
Vat +1) r(3 31), 


v(Z) = > FF [ z+ lat ast 
WO) TE 48) aay 


2 a ge Pe 

1. P,(z) has a singular point at z = —1 and is analytic in the remaining part of 
the complex plane, with a branch cut along (—co, —1]. 

2. Q_(<) has singular points at z = +1 and is analytic in the remaining part of 


the complex z—plane, with a branch cut along (—oo, +1]. The Q, function is 
not defined if vy = —1, —2,.... 





6.24.2 RELATIONSHIPS 
P_y-1(z) = P,(z), 
Q_ v-1(z) = Q,(z) — reot vmP,(z). 
Let n > m, then 





6.24.3 RECURSION RELATIONSHIPS 
(v + 1)Pi4i(z) = (Qn + 1)zP,(z) — vP,-1(2), 
(2v + 1)PL(z) = Pai (2) — Ph_a(e), 
(v + 1I)PL(z) = Pryi(2) — 2PL(2), 
UP, (2) = 2Py(2) -— Pyal2), 
(1 — 27) Pi (2) = vP,_a(2) — veP,(2). 








The functions Q,(z) satisfy the same relations. 
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FIGURE 6.8 
Legendre functions Py (x), n = 1, 2,3 (left) and Qn(x), n = 0,1, 2,3 (right) on the interval 
[—1, 1]. (From N. M. Temme, Special Functions: An Introduction to the Classical Functions 
of Mathematical Physics, John Wiley & Sons, 1996. Reprinted with permission of John Wiley 
& Sons, Inc.) 

















6.24.4 INTEGRAL REPRESENTATIONS 
2 [* — cosh(v + $)0 


P,(cosha) = — a — ae SE 7 
T Jo 2cosh a — 2 coshé 
1 a —(v+1/2)0 
re (epee UN ne 
T J-g V2cosha — 2 coshé (6.24.2) 
a [ dp 
~ «Jo (cosha + sinha cosy)’t! 
1 Tv 
== | (cosh a + sinha cos w)” dip. 
T JO 
B ‘ 1)\6 
Poss) = __cosvt3)8 an 


/2 cos? — 2cos 8 


ee ee (6.24.3) 
(cos 8 + isin 8 cosw)’tt 


(cos 6 + isin 6 cosw)” dw. 


3 


l| 


AIH ATH Aly 


oe yes 
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—v-1 , (Lage) 
Q,(z) = 2 —~——_ dt Rev > —1, |argz| <7, z € [-1,]] 


| (z = t)jy+l 
ei —v-1 
_ | lz + V2? — - dd 
0 
oo ev +1/2)0 (6.24.4) 
z = cosha. 


B /2coshé — 2cosha a 


6.24.5 POLYNOMIAL CASE 


Legendre polynomials occur when vy = n = 0,1, 2,... (see page 453) 








1 ee 
P,(z) =F (+ n+1;1;5— 5) (6.24.5) 
m 1 5 
~ k(2n — 2k)! any aN, if n even, 
a ~ 2 pa ere ta ee 
2” ki (n — k)! (n — 2k)! 1(n—1), ifn odd. 
2 
The Legendre polynomials satisfy Pal £) Pry (x) dx = ———dnm-. 
2n+1 
The Legendre series representation is is 
Qn+1 f* 
= 3 AnP,(t), An = “+ / f(x)P, (2) de. (6.24.6) 
se -1 


For integer order, we distinguish two cases: Q,,(a) (defined for « € (—1,1)) 
and (,,(z) (defined for Re z ¢ [—1, 1]): 











I 1+ 1 1+ 
Qo(z) = 5 no—, Q(z) = 5 en — sil (6.24.7) 
ie i ek tg: Bl 
Qo(z) = 5 n—, Qi(z) = 52h —1. (6.24.8) 
In both cases 
n—1 
= Qk+ Di] =(-1)""*| 
Qn(y) = Pr(y)Qo(y) — d “tn tk+ijm—m 7 * (6.24.9) 


Pala)Qala) ~ $2243 
P4(x)Qo(x) — Parr + Bax 
P3(x)Qo(x) — Bat+ 2a2?-FS 
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6.24.6 ASSOCIATED LEGENDRE FUNCTION 


The associated Legendre differential equation is 


2 
(1 — 2?)y” — 2zy' + |v(v +1) a y=0. 
1-2? 





The solutions P!(z),Q#(z), the associated Legendre functions, can be given in 
terms of Gauss hypergeometric functions. We only consider integer values of ju, v, 
and replace them with m,n. Then the associated differential equation follows from 
the Legendre differential equation after it has been differentiated m times. 


6.24.7 RELATIONSHIPS BETWEEN THE ASSOCIATED AND 
ORDINARY LEGENDRE FUNCTIONS 
The following relationships are for z ¢ [—1, 1] 


pm(z) =(2-13" 4 








n de™ 
= "2 -yim S ey, 
Pema) = PEE Pee), 
ame) = (2-1 ZS aala) 
Qua) = PET ane), 


6.24.8 RECURSION RELATIONSHIPS 





Pre(2) +$ SEE Pima) = (n= m4 Yin MP2), 
(2? — Aa) = mzP)"(z) + z2—.pmt (z), 
(2n + 1)zP™(2) = (n— m+ 1)PM4(2) + (n+ m)P™ (2), 
(Gu1 82 2 mapa @-We Derr, 














dz 
PM (2) — PM s(2) =—(2n + 1) V2 — 1PP-1(2). 


The functions Q7"(z) satisfy the same relations. 
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6.25 POLYLOGARITHMS 





* dt 
Li, (z) = — =-—In(1- 2), logarithm 
5; t= 
* Li(t *In(l—t 
Lig(z) = | BD) pe | BY) ait sanitiin 
o ¢ 0 t 
7 Li,-1(¢ e 
Li, (z =| HO iy, n> 2, polylogarithm 
3 ; 
z Of pee 
Li, (z =o ao tt Rev > 0, z & {Re z € [1, co], Im z = 0} 


6.25.1 POLYLOGARITHMS OF SPECIAL VALUES 


: 1? . 1? . 1? In 2)? 
Lil) =", Lig(-1)=-%, Lia(d) = 5 - 


Li,(1) =¢(v), Rev >1 (Riemann zeta function) 





6.25.2 POLYLOGARITHM PROPERTIES 


1. Definition: For any complex v 


Oo” cok 





z 
Li, (z) = —, 1. 
w@=>°5, lel< 
k=1 

2. Singular points: z = lisa singular point of Li, (z). 
3. Generating function: 

= : PO ewe i 

» w”* Lin (z) = z i ; dt, z¢[1,00). 

a 0 eo = 2 


The series converges for |w| < 1, the integral is defined for Re w < 1. 
4. Functional equations for dilogarithms: 


1 
Lig(z) + Lig(1 — z) = 6 q —Inz In(1 — 2), 


5 Lia(2”) = Lig (a) + Lig(—2), 


Lig(—1/2) + Lig(—x) = (In x)’, 





Nle 


Lig(—ay/z) + Lig(—yz/ax) + Lig(—z2/y), 
where 1/a+1/y+1/z=1. 
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6.26 PROLATE SPHEROIDAL WAVE FUNCTIONS 


The spheroidal wave functions P”(x, 7) are the solutions of 


2 
as ((-2) *) ~ (470-24) is “) w =0, (6.26.1) 


that are bounded on (—1, 1), with real parameters A, y?, and m = 0,1,2,..... So- 

lutions only exist for special values of A, namely, the eigenvalues \’" (77). When 

7 = 0, they reduce to the associated Legendre functions with \7"(0) = n(n + 1). 
Uaing y = ro (fort, o > 0) the prolate spheroidal wave functions (n,c,r(t) are 


(2n + 1)An 


t 
Yn.o,7(t) = 4{ —.—— pe (=. ?) , forn=0,1,2,... (6.26.2) 
i 2T T 





where An = An,r,0 > 0. 
1. Differential Equation here v,,,,7 are different eigenvalues 


d? d 
(7? — p2) 2 Prot _ ap Peet ie OV On i = Vyn,o,7'Pn,o,7) (6.26.3) 


2. Integral Equations 


= sinao(t — x 
/ ee dx = Ann,o,r (t) 


a a(t — x) 
ee sin a(t — x) 
i Prior (®)— d& = Pn,o,r(t) (6.26.4) 


/ Pn,o,t @e- errs dt = Yn,0,7Pn,0,7 (w) 
Yn,o,7 (t)\Pm,o,7 (t) dt = AnOmyn 
a (6.26.5) 


/ Qn,o,r (t)Pm,o,r (t) dt = Om,n 


3. Orthogonality a 


4. Fourier Transform here y.(w) = 1 on (—o,c), and zero otherwise. 
oo 5) 
i e.  ee. alt) dt = (—1)” cial n,o,7 (=) Xo(w) (6.26.6) 
66 OAn o 


5. Discrete Orthogonality 


> Prior (=) Pn,o,7 (=) = 9k,m (6.26.7) 


n=0 
6. Special Summation 


CoO 
> Pn,o,7 (t)Pn,o,7 (£) = 
n=0 


sin o(t — x) 
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6.27 SINE, COSINE, AND EXPONENTIAL 
INTEGRALS 


6.27.1. SINE AND COSINE INTEGRALS 
* cost — 1 


z = t 
Si(z) = | — dt, Ci(z) =y+Inz +f — dt, 
o + 0 


where 7¥ is Euler’s constant. 


1. Alternative definitions: 


1 © sint °° t 
si(z)=52- [ ae dt, ci() =- | — dt. 


bes poke a 1 ‘ 
2. Limits: Jim, Si(z) = 5” jim Ci(z) = 0. 
3. Representations: 


Si(z) = —f(z) cosz — g(z) sinz + T, 


Q 
=. 
es 
x 
x 
lI 


+f(z)sinz — g(z) cosz, 


co e 7% te #t 
= —— dt = —>— dt 
fe)=f ae oo=-[ 2 


4. Asymptotic expansion: For z + 00, | arg2z| < 7, 


where 


lee} 


fe~s oy) Say 


z 
n=0 n=0 


6.27.2 EXPONENTIAL INTEGRALS 


co .-—2t 
Ba(e) = f — dt, Rez>0, n=1,2,.... 
1 


n—1,—2z co ,—2tyn—-1 
t 
- | dt, Rez>0. 
0 


oo ,-t 
1. Special case: E\(z) a — dt, |argz| <7. 


= pt 
For real values Ei(x) = / — dt, where for z > 0 the integral is interpreted 


CO 
as a Cauchy principal value integral. 
2. Representations: 


a 
E;(z) =-y-mnz+ | 
0 


—t 





Ey (ze4™) = —-y-Inz— Ci(z) +i 5 T+ si) ; 


E\(x) = — Ei(—2), x >0 
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FIGURE 6.9 
Sine and cosine integrals Si(x) and Ci(x), for0 < x < 8 (From N. M. Temme, Special 


Functions: An Introduction to the Classical Functions of Mathematical Physics, John Wiley 
& Sons, 1996. Reprinted with permission of John Wiley & Sons, Inc.) 


27 Si(x) 
n/2 





Ci(x) 








6.27.3 LOGARITHMIC INTEGRAL 
re sae ae 
li(z) = | ne Ei(Inz), 


where for x > 1 the integral is interpreted as a Cauchy principal value integral. 


6.27.4 sancti ea 


0. a0 

0.19955609 ~1.04290860 149334875 0.672006 
0.39646146 | —0.37880935 | 1.04782801 | 0.07022623 
0.58812881 | —0.02227071 | 0.82793344 | 0.42251981 
0.77209579 | 0.19827862 | 0.69124540 | 0.60542430 


0.94608307 | 0.33740392 | 0.59634736 | 0.69717488 
1.60541298 | 0.42298083 | 0.36132862] 0.67048271 
1.84865253 | 0.11962979 | 0.26208374 | 0.49457640 
1.75820314 | —0.14098170 | 0.20634565 | 0.385955201 
1.54993124 | —0.19002975 | 0.17042218 | 0.27076626 
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6.28 WEIERSTRASS ELLIPTIC FUNCTION 


The Weierstrass elliptic function, y = (2) = (2; w1,w3), is defined as the inverse 


of the elliptic integral 
a ds 
z= ——_—_—_———. (6.28.1) 
y 


4/48" — 928 — 93° 


where gz and g3 are constants. The result follows from the differential equation 
[0 (z)]? = 4[(z)]8 — goe(z) — g3. The parameters { go, 93} are the invariants of ¢. 


6.28.1 PROPERTIES 


1. If {e1, e2, e3} are the roots of the cubic 4° — gos — g3 = 0, then 
gi = 0 =A(e1 +€2 +3), go = —A(e1€2 + e1€3 + ene3) = 2 (e7 + €3 + €3), 
and g3 = 4e e2e3. Define the periods of ¢ (denoted {w;}) by 


Ww Ww Ww 
p (=) ae (=) io. (=) — 4 (6.28.2) 
Then we find w, + w2 + w3 = 0 and 
e(zt+ui)=(z), t=1,3, (6.28.3) 


which means that ¢ is doubly periodic with periods w, and ws. 
2. Addition theorem 


_1ie@-P)) _ oy oy 
out 0) =F] OS) — ota) — oe) 6.28.4) 


3. Changing parameters 
(2; —w3,W1) = 0(2361,W3). (6.28.5) 


4. (2; w1,w3) is real valued when z is real, w, is real and w3 is pure imaginary. 


1 
5. g2 = 60 x ——_ a 93 = 140 > —__—____. 
oer (mw, + nw3) mrs (mw, + nw3) 


6.28.2 RELATION TO JACOBI ELLIPTIC FUNCTIONS 


= 1 en(z) — ,/ 2 =e ale) — | 2&2 
sn(z) = (2) — €3. ( ) g(z) — €3’ d ( ) o(z) — €3 
(6.28.6) 


6.28.3 SERIES EXPANSION 
1 1 1 
go(z; Wy, W3) = a > ee 


wee es nw3)? (mw, + nw3)? 





1 92 2 4 Zt Ole) 


~ 22 * 20 28 





(6.28.7) 
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6.29 INTEGRAL TRANSFORMS: LIST 


Abel transform 


_sin(am) d f* f(t) 
o) T =f (a — t)!-¢ 


Fourier transform 


fe= Fal far d 


Fourier cosine transform 


= ‘an cos(ux) f(x) da 


Fourier sine transform 


_ rE | ” ain (ebay 0) 


Hankel transform 


Hartley eae 

flu) = =/. [cos(ux) + sin(ua)] f(x) dx 
an 

f(x) 


[cos(wa) + sin(ux)] f(u) du 


“vel 


Hilbert transform 


fly) = * py 


Kontorovich— ichedey transform 


[ Kela) fle) ax = Ku(0)f(u) du 
0 0 


Laplace transform 


| * eFax) dn 


Two-sided Laplace transform 


/ : eP® f(x) da 


© OG 
=i 
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Meijer transform (/-transform) 


= 2 ; © mnt Lease ait 


Mellin transform 


- love) c+i100 a 
fis) = fo sayae fe)=s5 fa *Fls)ds 


Y -transform 


w= fr Jas Y, (ux) (x) de 





6.30 INTEGRAL TRANSFORMS: PRELIMINARIES 


. I =(a,)) is an interval, where —co <a <b<o. 


2. L*(Z) is the set of all Lebesgue integrable functions on J. In particular, L+(R) 


is the set of all Lebesgue integrable functions on the real line R. 


. [?(1) is the set of all square integrable functions on I (ice., 


Jr lf (2)? dx < 00). 


. If f is integrable over every finite closed subinterval of J, but not necessarily 


on I itself, we say that f is locally integrable on I. For example, the func- 
tion f(a) = 1/z is not integrable on the interval J = (0,1), yet it is locally 
integrable on it. 


. A function f(a), defined on a closed interval [a,b], is said to be of bounded 


variation if there is an MZ > 0 such that, for ae partition a = % < x < 


- << £, = 6, the following relation holds: ys | f(a) — f(ai-i)| < M. 


. If f has a derivative f’ at every point of [a, b], thent by the mean value theorem, 


for anya <a < y < b, we have f(x) — f(y) = f’(z)(a — y), for some 
u<z<y.If f’ is bounded, then f is of bounded variation. 


. The left limit of a function f(a) at a point ¢ (if it exists) will be denoted by 


lim,_.,- f(z) = f(t—), and likewise the right limit at ¢ will be denoted by 
Hing e+ P(e) = F(t4). 





6.31 FOURIER INTEGRAL TRANSFORM 


The origin of the Fourier integral transformation can be traced to Fourier’s celebrated 
work on the Analytical Theory of Heat, which appeared in 1822. Fourier’s major 
finding was to show that an “arbitrary” function defined on a finite interval could be 
expanded in a trigonometric series. In an attempt to extend his results to functions 
defined on the infinite interval (—oo, co), Fourier introduced what is now known as 
the Fourier integral transform. 
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The Fourier integral transform of a function f(t) is defined by 








F(f\(w) = fle) = FW) a ‘ f(iet dt, (6.31.1) 


whenever the integral exists. 

There is no universal agreement on the definition of the Fourier integral trans- 
form. Some authors take the kernel of the transformation as e~*”, so that the kernel 
of the inverse transformation is e’“’. In either case, if we define the Fourier trans- 
forms 





fw) =a f sie at 


then its inverse is 





fo =o f ” flweP™ day, 


for some constants a and b, with ab = 1/27. Again there is no agreement on the 
choice of the constants; sometimes one of them is taken as | so that the other is 
1/(27). For the sake of symmetry, we choose a = b = 1/1/27. The functions f and 
f are called a Fourier transform pair. 

A definition popular in the engineering literature is the one in which the kernel 
of the transform is taken as e?" (or e727") so that the kernel of the inverse 
transform is e~?7"™ (or e?"*). The main advantage of this definition is that the 
constants a and b disappear and the Fourier transform pair becomes 








f(w) = / fojer" ad md fie / f(w)et?™™ dw. (6.31.2) 
The Fourier cosine and sine coefficients of f(t) are defined by 


ioe ~[- pier tad, GOR ~[- f(t)sinwtdt. (6.31.3) 


The Fourier cosine and sine coefficients are related to the Fourier cosine and 
sine integral transforms. For example, if f is even, then a(w) = \/2/7F.(w) and, if 
f is odd, b(w) = \/2/7F(w) (see Section 6.31.7). 

Two other integrals related to the Fourier integral transform are Fourier’s re- 
peated integral and the allied integral. Fourier’s repeated integral, S(f,t), of f(t) is 
defined by 


S(f,t) = [ (a(w) cos tw + b(w) sintw) dw, 

ne as (6.31.4) 

=— dw x w(t — x) dz. 
=f def sle)coswtt 2) 
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The allied Fourier integral, S(f, t), of f is defined by 


S(f,t) = [ (b(w) cos tw — a(w) sintw) dw, 


= -[- aw f few hae 


(6.31.5) 


6.31.1. PROPERTIES 


1. 


10. 


Linearity: The Fourier transform is linear, 
F laf (t) + bg(t)] (w) = oF [f(6)] (w) + oF [9(t)] (w) = af) + b9(), 


where a and b are complex numbers. 


. Translation: F [f(t — b)] (w) = e®™ f(w). 








7. 
. Dilation (scaling): F [f(at)] (w) = - (. a>0 
a 
1. . 
. Translation and dilation: F | f (at — a2! (w) = —et/o Ff (=) , a>O0 
a a 
. Complex conjugation: Fie) | (w) (—w). 
. Modulation: F [e'* f (t)] (w) = jw a), and 
i 
F [e'** f(bt)] (@) = 5 (“=*). b> 0. (6.31.6) 
: alae If f) € L'(R), fork =0,1,2,--- ,n and 
lime|+o0 f(t) = 0 for k = 0,1,2,--- ,n — 1, then 
F([F™@) hive (—iw)”" f(w). (6.31.7) 
. Integration: Let f € L1(IR), and define g(x) = f”., f(t) dt. If g € L'(R), 


then §(w) = —f(w)/(iw). 


. Multiplication by polynomials: If t* f (t) € L1 (IR) for k = 0,1,...,n, then 


F [t* f)] @) = —e" (w), (6.31.8) 
and hence, 
7 (>: a) 70) w)=>- at® (w). (6.31.9) 
k=0 k=0 


Convolution: The convolution operation, *, associated with the Fourier trans- 
form is defined as 


h(t) = (Ff xg)(2) =|. f(a)g(t — 2)de 


where f and g are defined over the whole real line. 

THEOREM 6.31.1 

If f and g belong to L'(R), then so does h. Moreover, h(w) = f(w)g(w). If 
f and g belong to L'(R), then (f * 9)(w) = (fg)(w). 
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11. Parseval’s relation: If f,g € L?(IR), and if F and G are the Fourier transforms 
of f and g, respectively, then Parseval’s relation is 


i- F(w)G(w) dw = i f(t)g(—t) dt. (6.31.10) 


Replacing G by G (so that g(—t) is replaced by G(t)) results in a more conve- 
nient form of Parseval’s relation 


/ 7 F(w)G(w) dw = / 7 f (t)g(t) dt. (6.31.11) 
In particular, for f = g, 
[- |F(w)|? dw = i If (e)/P dt. (6.31.12) 


6.31.2 EXISTENCE 


For the Fourier integral transform to exist, it is sufficient that f be absolutely inte- 
grable on (—oo, 00), ie., f € L1(R). 


THEOREM 6.31.2 (Riemann—Lebesgue lemma) 
If f € L*(R), then its Fourier transform f(w) is defined everywhere, uniformly 
continuous, and tends to zero as Ww —> +00. 





The uniform continuity follows from the relationship 


flw+h)— se fl f(t) Je — 1| dt, 





and the tendency toward zero as w —>+ too is a consequence of the Riemann— 
Lebesgue lemma. 


THEOREM 6.31.3 (Generalized Riemann—Lebesgue lemma) 

Let f € L*(I), where I = (a,b) is finite or infinite and let w be real. 
Leta<a' <b! < band ia (A, a’, b’) = fer dé. 

Then im f(A, a’, b’) = 0, and the convergence is uniform in a! and 0’. 


: : CO iwt = 
In particular, lim Life a =0. 








6.31.3. INVERSION FORMULA 


Many of the theorems on the inversion of the Fourier transform are based on Dini’s 
condition which can be stated as follows: 
If f € L+(R), then a necessary and sufficient condition for 


ae sinA(z—t) , 
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is that 


im f (f@+y)+fle-y)—20) ee ay 


A>0o 0 y 





= 0, (6.31.14) 


for any fixed 6 > 0. By the Riemann—Lebesgue lemma, this condition is satisfied if 


[ fa+y)t f(e—y) -24 
0 y 

for some 6 > 0. In particular, condition (6.31.15) holds fora = f(x), if f is 
differentiable at x, and for a = [f(a+) + f(x—)] /2, if f is of bounded variation in 
a neighborhood of x. 


THEOREM 6.31.4 (Inversion theorem) 
Let f be a locally integrable function, of bounded variation in a neighborhood of the 


point x. If f satisfies either one of the following conditions: 
1. f(t) € L'(R), or 
2. f(t)/(1+|t)) € L'(R), and the integral [~. f (t)e’' dt converges uniformly 
on every finite interval of w, 


dy < o, (6.31.15) 





then 


= | fe) a= dim wf f(w)e*” dw 


is equal to |f(a+) + f(a—)] /2 whenever the expression has meaning, to f(x) 
whenever f(x) is continuous at x, and to f(x) almost everywhere. If f is contin- 
uous and of bounded variation in the interval (a, b), then the convergence is uniform 
in any interval interior to (a, b). 


6.31.4 UNCERTAINTY PRINCIPLE 
Let T’ and W be two real numbers defined by 


roof “IF (2 dt and wear | wl fw)Pdw, 6.31.16) 


E= fou (t)|? dt = a | f(w) |? du. (6.31.17) 


—Co 


where 


Assuming that f is differentiable and | mee tf?(t) = 0, then 2TW > 1, or 
t|—>0o 


love) 1/2 fore) 7 1/2 love) 
([- @irwar) (f »*flw)/? av) > 5/ _vorar (6.31.18) 


This means that f and ¥ cannot both be very small. Another related property of the 
Fourier transform is that, if either one of the functions f or f vanishes outside some 
finite interval, then the other one must trail on to infinity. In other words, they cannot 
both vanish outside any finite interval. 
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6.31.5 POISSON SUMMATION FORMULA 


The Poisson summation formula may be written in the form 


1 ie k oe 

Tk y r(t+2)=2 5 f2ko)e72**", gg 30, (6.31.19) 
Tv 
k=—0o 


k=—0o 


provided that the two series converge. A sufficient condition for the validity of Equa- 
tion (6.31.19) is that f = O(1 + |t|)~% as |t| > 00, and f = O((1 + |w|)~®) as 
|w| — co for some a > 1. 

Another version of the Poisson summation formula is 


3 f( (w+ ko )9( w+ko) = i. f(t) a(t- =*) at) e2tikw/o 


k=—oo na SEES 
(6.31.20) 
6.31.6 SHANNON’S SAMPLING THEOREM 
If f is a function band-limited to [—o, o], i.e., f(t) = =| F(w)e™ dw, 
T J—o 


with F € L?(—o,c), then it can be reconstructed from its sample values at the points 
ty = (kr)/o,k =0,+1, +2,---, via the formula 


a #5 eel (6.31.21) 
=4) 














k=—0o 


with the series absolutely and uniformly convergent on compact sets. 
The aS on - right-hand side of Equation (6.31.21) can be written as 


sin ot oo f( te) hy y which is a special case of a Cardinal series (these se- 


(-1)* 


mG t — kr) ) 


ries have the form = sinot > 
k=—oco 


6.31.7 FOURIER SINE AND COSINE TRANSFORMS 


The Fourier cosine transform, F/.(w), and the Fourier sine transform, F’,(w), of f(t) 
are defined for w > 0 as 


w= 2 fn f(t)coswtdt and F;,( o=\2 fn f(t) sinwt dt. 


(6.31.22) 
The inverse transforms have the same functional form: 


Oa fe 2 fe 
=4/ - | F,(w) cos wt dw = 4/ - | F,(w) sin wt dw. (6.31.23) 
T JO T Jo 


If f is even, ie., f(t) = f(—t), then F(w) = F.(w), and if f is odd, ice., 
f(t) = —f(—t), then F(w) = iF; (w). 
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6.32 DISCRETE FOURIER TRANSFORM (DFT) 


The discrete Fourier transform of the sequence dole e. where N > 1, is a se- 
quence { A,,,}.’—}, defined by 


m=0? 
N-1 
Am = CS Qn(Wn)™, for m=0,1,---,N—1, (6.32.1) 
n=0 


where Wy = €?7*/N, Note that 7} witkn) 


of the sequence {1,0, 1,1} is {3, —2, 1, i}. 
The inversion formula is 


= Nogn. For example, the DFT 


N-1 
1 
On =— S) AmWy™, n=0,1,---,N-1. (6.32.2) 


m=0 


Equations (6.32.1) and (6.32.2) are called a discrete Fourier transform (DFT) pair of 
order NV. The factor 1/N and the negative sign in the exponent of Wy that appear 
in Equation (6.32.2) are sometimes introduced in Equation (6.32.1) instead. We use 


the notation 
Fril@ol]An Fy \Aa)l= te (6.32.3) 


to indicate that the discrete Fourier transform of order N of the sequence {a,,} is 
{A,,} and that the inverse transform of {A,,,} is {ay}. 

Because were = W,,""", Equations (6.32.1) and (6.32.2) can be used to 
extend the sequences eo are and yn aan as periodic sequences with period 
N. This means that Amin = Am, and ann = Gy. This will be used in what 
follows without explicit note. Using this, the summation limits, 0 and N — 1, can 
be replaced with n; and n; + N — 1, respectively, where n1 is any integer. In the 
special case where nj = —M and N = 2M -+ 1, Equations (6.32.1) and (6.32.2) 
become 








Am = : anWe", for m=—-M,—-M+1,---,M—1,M, (6.32.4) 
n=—M 
and 
1 M 
= STI ns AmWy”™", for n=—M,-M+1,---,M-1,M. 


(6.32.5) 
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6.32.1 PROPERTIES 
1. Linearity: The discrete Fourier transform is linear, that is 
Fn [a(an) 2. B(bn)] = aAm + BBm, 


for any complex numbers a and (3, where the sum of two sequences is defined 
as (dn) + (bn) = (Gn + bn). 


2. Translation: Fn [(an—k)| = We Aras or 
rimbl A, = NE ag WM 

3. Modulation: Fn |(WR*an)] = Am+k, Of Am+k = eee eek N a We 

4. Complex Conjugation: Fy |(G@_n)] = Am, or Am = Sia: a_»Wy”. 

5. Symmetry: Fy |(a—n)] = A-m,0t Am = Se og i_»,We. 

6. Convolution: The convoys of the sequences {an} and 1.) | is the 


sequence {c,}—)| given by 


= Online: (6.32.6) 


The convolution relation of the DFT is Fn|(cn)| = Fn|(an)|Fn[(bn)], or 
Cm = AmBm. A consequence of this and Equation (6.32.2), is the relation 


N-1 
y Akbn—k = ¥D Am Bw (6.32.7) 
7. Parseval’s relation: 
N-1 1 No 
dn = — AmDm- 32. 
Si an a (6.32.8) 
n=0 m=0 
In particular, 
N-1 {= 
2 2 
dX lan? = x An. (6.32.9) 


In (4) and (5), the fact that Wy = Wy has been used. A sequence {a,, } is said 
to be even if {a_,} = {a,,} and is said to be odd if {a_, } = {—a,}. The following 
are consequences of (4) and (5): 


1. If {a,,} is a sequence of real numbers (i.¢., = Gn), then Aj, = A_m 
2. {a,} is real and even if and only if {A,,,} is real and even. 
3. {a,,} is real and odd if and only if {A,,} is pure imaginary and odd. 
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6.33 FAST FOURIER TRANSFORM (FFT) 


To determine A,,, for each m = 0,1,--- , M@ — 1 (using Equation (6.32.1)), M —1 
multiplications are required. Hence the total number of multiplications required to 
determine all the A,,,’s is (MZ — 1)?. This number can be reduced by using decima- 
tion. 

Assuming is even, we define M = 2.N and write 


Fon {(an)] = Ayn (6.33.1) 


Now split {a,,} into two sequences, one consisting of terms with even subscripts 
(by, = @2,) and one with odd subscripts (c, = d2n41). Then 


Am = By: + WsnCm.- (6.33.2) 


For the evaluation of B,, and C;,, the total number of multiplications required is 
2(N — 1}*, To determine A,,, from Equation (6.33.2), we must calculate the product 

Wn Cm, for each fixed m. Therefore, the total number of multiplications required 
to aeene Am from Equation (6.33.2) is 2(N — 1)? +2N —-1=2N?—-2N +1. 

But if we had determined A,,, from (6.33.1), we would have performed (2N — 
1)? = 4N? — 4N +1 multiplications. Thus, splitting the sequence {a,,} into two 
sequences and then applying the discrete Fourier transform reduces the number of 
multiplications required to evaluate A,,, approximately by a factor of 2. 

If N is even, this process can be repeated. Split {b,,} and {c,,} into two se- 
quences, each of length NV/2. Then B,,, and C;,, are determined in terms of four 
discrete Fourier transforms, each of order N/2. This process can be repeated k — 1 
times if \/ = 2" for some positive integer k. 

If we denote the required number of multiplications for the discrete Fourier 
transform of order N = 2* by F(N), then F(2N) = 2F(N) + N and F(2) = 1 
which leads to F(N) = 4 log, N 





6.34 MULTIDIMENSIONAL FOURIER 
TRANSFORMS 


If x = (a1, %2,...,%n) and u = (uy, U2,..., Un), then (see the table on page 522): 
1. Fourier transform F(u) = (2x)-"/? 1s eT fixe dx. 
2. Inverse Fourier transform f(x) = (20)-"/? 1s . F(u)e*®™) du. 





3. Parseval’s relation ie aT f(x)g(x) dx = I ot F(u)G(u) du. 
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6.35 HANKEL TRANSFORM 


The Hankel transform of order v of a real-valued function f () is defined as 


#.(F)(y) = Fly) = | * Haar Weds, (6.35.1) 


for y > O and v > —1/2, where J,(z) is the Bessel function of the first kind of 
order v. 

The Hankel transforms of order 1/2 and —1/2 are equal to the Fourier sine and 
cosine transforms, respectively, because 


[| 2 / 2 
Jij2(x) = oe sin a, J_yj2(x) = ~, cose (6.35.2) 


As with the Fourier transform, there are many variations on the definition of the 
Hankel transform. Some authors define it as 


GL(y) = | xg(«) Jv (yx)dax; (6.35.3) 
0 
however, the two definitions are equivalent; we only need to replace f(x) by \/rg(x) 
and Fy, (y) by \/yGi(y). 


6.35.1 PROPERTIES 


1. Existence: Since \/xJ_(x) is bounded on the positive real axis, the Hankel 
transform of f exists if f € L1(0, 00). 
2. Multiplication by x”: 


ld 


He (0 Fla)) (w) =v? (ZF 


) tee eal) . 


3. Division by «: 
(10) W) =v) + Ral) 
Hy (=) (y) = yt?” ie i a 


0 


4. Differentiation: 


Hy (2vf'(x)) (y) = (¥ — a)yFsi(y) — V+ a)yFL-1(y). 


5. Differentiation and multiplication by powers of x: 


ty [ver (22) (artm—24(0))] (9) =u Foam) 


a dx 


504 CHAPTER 6. SPECIAL FUNCTIONS 


6. Parseval’s relation: Let F,, and G, denote the Hankel transforms of order v 
of f and g, respectively. Then 


[ Pneaay= [O fagae, (6.35.4) 
0 0 


In particular, [°° |F,(y)|? dy = {; \F@)Pae 
7. Inversion formula: If f is absolutely integrable on (0,00) and of bounded 
variation in a neighborhood of point x, then 


| 7 F,(y)./fzyJ.(yx)dy = ag aA (6.35.5) 


whenever the expression on the right-hand side of the equation has a meaning; 
the integral converges to f(a) whenever f is continuous at x. 





6.36 HARTLEY TRANSFORM 


Define the function cas 7 = cos x + sina = V2sin(2 + 4). The Hartley transform 
of the real function g(t) is 


(Hg)(w) = [- g(t) cas(2awt) dt. (6.36.1) 


—oo 


Let (£g)(w) and (Og)(w) be the even and odd parts of (Hg)(w), 


(Eg)(w) = 


(Og)(w) = 


((Hg)(w) + (Hg)(-w)) , 
((H9)(w) — (Hg)(-»)) , 


so that (Hg)(w) = (Eg)(w)+(Og)(w). The Fourier transform of g (using the kernel 
e?7*t) can then be written in terms of (Eg)(w) and (Og)(w) as 


(6.36.2) 


MLR wle 


I. g(t)e?™™* dt = (Eg)(w) + i(Og)(w). (6.36.3) 


—co 
Notes: 


1. The Hartley transform, applied twice, returns the original function. 
2. Note that 4 cas(x) = cas(—2). 

3. There is a fast Discrete Hartley transform (DHT) similar to the DFT. 
4. For even functions the Hartley and Fourier transforms are the same. 
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6.37 HILBERT TRANSFORM 


The Hilbert transform of f is defined as 


(H)(e) = fle) == f 1 y+ ~ [ Met 371) 


T 


where the integral is a Cauchy principal value. See the table on page 524. 

Since the definition is given in terms of a singular integral, it is sometimes im- 
practical to use. An alternative definition is given below. First, let f be an integrable 
function, and define a(t) and b(t) by 


i, > 1° 
=- i f(x) costadx, b(t) = — / f(a) sintadx. (6.37.2) 
T J 06 oe 
Consider the function F'(z), defined by the integral 
F(z)= | (a(t) — ib(t))e*** dt = U(z) + iU(z), (6.37.3) 
0 
where z = x + iy. The real and imaginary parts of F' are 
U(z)= | (a(t) cost + b(t) sinxt)e~“ dt, and 
a (6.37.4) 
U(z) = | (a(t) sin xt — b(t) cosxt)e™ dt. 
0 
Formally, 
lim U(z) = f(x) = | (a(t) cos at + b(t) sin xt) dt, (6.37.5) 
y> 0 
and 
lim U(z) = —f(x) = | (a(t) sin at — b(t) cos zt) dt, (6.37.6) 
yO 0 


The Hilbert transform of a function f, given by Equation (6.37.5), is defined as 
the function f given by Equation (6.37.6). 


6.37.1 EXISTENCE 


If f € L*(R), then its Hilbert transform (Hf)(x) exists for almost all a. For f € 
L?(R),p > 1, there is the following stronger result: 


THEOREM 6.37.1 
Let f € L?(R) for 1 < p< o. Then (Hf)(x) exists for almost all x and defines a 
function that also belongs to L?(IR) with 


a (Hf) (x yPar< cy fis x)|? de. (6.37.7) 
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In the special case of p = 2, we have 


[ota ae = J fC ae. (6.37.8) 


—co —oco 


The theorem is not valid if p = 1 because, although it is true that (1 f)(x) 
is defined almost everywhere, it is not necessarily in L'(R). The function f(t) = 
(t log” t)-' H(t) provides a counterexample. 


6.37.2 PROPERTIES 


1. Translation: The Hilbert transform commutes with the translation operator 


(Hf)(@ + a) = H(f(t + a))(2). 


2. Dilation: The Hilbert transformation also commutes with the dilation operator 


(Hf)(ax) = H(f(at))(@) a> 0, 


but 
(Hf)(ax) = —H(f(at))(x) fora <0. 


3. Multiplication by t: H(tf (t))(x) = «(Hf)(a) + 7 f(t) dt. 


4. Differentiation: H(f'(t))(x) = (Hf)'(x), provided that f(t) = O(t) as |t| > 
oo. 

5. Orthogonality: The Hilbert transform of f € L7(IR) is orthogonal to f in the 
sense f°. f(x)(Hf)(x)dx = 0. 

6. Parity: The Hilbert transform of an even function is odd and that of an odd 
function is even. 


7. Inversion formula: If (Hf)(x) = |" i) dt, then 
@ a (Hf )(x) i 


-———— dz or, symbolically, 
T t 


f®=- 


—~co &~ 


H (Hf) (a) = —f(2), (6.37.9) 


that is, applying the Hilbert transform twice returns the negative of the original 
function. Moreover, if f € L'(IR) has a bounded derivative, then the allied 
integral (see Equation 6.31.5) equals (Hf) (a). 

8. Meromorphic invariance: 


(HF)(u(a)) = Fula) == f © 10 at / * Lu a 


where 








for arbitrary a, > 0 and b,, real. 
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6.37.3 RELATIONSHIP WITH THE FOURIER TRANSFORM 
From Equations (6.37.3)—(6.37.6), we obtain 


lim F(z) = F(a) = [aw — ib(t))e'™ dt = f(x) —i(Hf)(2), 


yO 


where a(t) and b(t) are given by Equation (6.37.2). 
Let g pe a real- ae, integrable function and consider its Fourier transform 





g(a) = z= pee - e’*! dt. If we denote the real and imaginary parts of g by f 
and t 5 a as ie 
fle) = = | glt)eosztdt, and 
¢)=—= cos xt dt, an 
V20 ee 
s iL mS 
t) = —= t) sin xt dt. 
fay=s= fo 
Splitting g into its even and odd parts, ge and go, respectively, we obtain 
g(t) + g(—t) g(t) — g(=t 
g(t) = EY god g(t) = OK. 
2 2 
hence 
9 [oe) 
= 4/— ge(t)cosatdt, and f(a Jo(t) sin xt dt, 
T Jo 
(6.37.10) 
or 
f{i2)= =< / * ge(t)e dt, and f(a a dt. 
‘ V2T Ico , =) Qa 
(6.37.11) 


This shows that, if the Fourier transform of the even part of a real-valued function 
represents a function f(x), then the Fourier transform of the odd part represents the 
Hilbert transform of f (up to multiplication by 7). 


THEOREM 6.37.2 
Let f € L*(R) and assume that Hf is also in L'(R). Then 


F(Hf)(w) = —isgn(w)F(f)(w), (6.37.12) 


where F denotes the Fourier transformation. Similarly, if f € L?(R), then (Hf) € 
L?(R), and Equation (6.37.12) remains valid. 
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6.38 LAPLACE TRANSFORM 


The Laplace transformation dates back to the work of the French mathematician, 
Pierre Simon Marquis de Laplace (1749-1827), who used it in his work on probabil- 
ity theory in the 1780s. 

The Laplace transform of a function f(t) is defined as 


F(s) = [Lf] (s) = - f(te—* dt (6.38.1) 


(also written as [£ f (t)] and [£ (f(t))] ), whenever the integral exists for at least one 
value of s. The transform variable, s, can be taken as a complex number. We say that 
f is Laplace transformable or the Laplace transformation is applicable to f if [Lf] 
exists for at least one value of s. 


6.38.1 EXISTENCE AND DOMAIN OF CONVERGENCE 
Sufficient conditions for the existence of the Laplace transform are 


1. f is a locally integrable function on [0, 00), ie., tie |f(t)| dt < oo, for any 
a> 0. 
2. f is of (real) exponential type, i.e., for some constants M, tp > O and real 7, f 
satisfies 
|f(t)| < Me™, for all t > to. (6.38.2) 


If f is a locally integrable function on [0, oo) and of (real) exponential type y, 
then the Laplace integral of f, i f (t)e~** dt, converges absolutely for Re s > 
and uniformly for Re s > 7, for any 71 > y. Consequently, F'(s) is analytic in 
the half-plane Q = {s¢C:Res> vy}. It can be shown that if F'(s) exists for 
some So, then it also exists for any s for which Re s > Re so. The actual domain 
of existence of the Laplace transform may be larger than the one given above. For 
example, the function f(t) = cose? is of real exponential type zero, but F'(s) exists 
forRe s > —1. 

If f(t) is a locally integrable function on [0, oo), not of exponential type, and 


| . f(t)e*" dt (6.38.3) 
0 


converges for some complex number So, then the Laplace integral 


i) 7 f(t)e-* dt (6.38.4) 
0 


converges in the region Re (s) > Re (so) and converges uniformly in the region 
7 


larg(s — s9)| < @ < 5. Moreover, if Equation (6.38.3) diverges, then so does 
Equation (6.38.4) for Re s < Re so. 
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6.38.2 PROPERTIES 


1. Linearity: L(af + 8g) = al(f) + BL(g) =aF + BG, 
for any constants a and /. 
1 
2. Dilation: (£ (f(at))] (s) = —F (=). for a>0. 
a \a 
3. Multiplication by exponential functions: 


[L (ef (t))] (s) = F(s — a). 
4. Translation: |L (f(t — a)H(t — a))] (s) = e~**F(s) for a > 0; where H is 
the Heaviside function. This can be put in the form 


[L( f(t) H(t — a))] (s) =e [LF(E + @))] (s), 
Examples: 
(a) If 
0, 0<t<a, 
gl) = i —a)’, ax<t, 
then g(t) = f(t — a)H(t — a) where f(t) = t” (for Re v > —1). Since 
L(t’) =T(v +1)/s”t", it follows that (Lg)(s) = e~*T(v + 1)/s”*1, 
for Re s > 0. 
(b) If 


we may write g(t) = t |H(t) — H(t — a)| = tH(t) —(t—a)H(t—a) 
aH (t — a). Thus by properties (1) and (4), 
1 1 a 


Gis={——=8 “=e, 
8 8 





5. Differentiation of the transformed function: If f is a differentiable function of 
exponential type, lim:.0+ f(t) = f(O0+) exists, and f’ is locally integrable 
on [0, 00), then the Laplace transform of f’ exists, and 


(Lf’) (s) = sF(s) — f(0). (6.38.5) 


Note that although f is assumed to be of exponential type, f’ need not be. For 
example, f(t) = sine’, but f/(t) = 2te” cose". 


6. Differentiation of higher orders: Let f be an n times differentiable function 
so that f) (for k = 0,1,...,n — 1) are of exponential type with the addi- 
tional assumption that limy.94 f(t) = f“ (0+) exists. If f™ is locally 
integrable on [0, oo), then its Laplace transform exists, and 


[£ (£)] (s) = s"F(s) — s*-1¥(0) — 8"? f"(0) —... = FDO). 
(6.38.6) 
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. Integration: If g(t) = =f i x) dx, then (if the transforms exist) G(s) = 
F'(s)/s. Repeated ey ss this rule result in 
1 
[< (g-")| (s) = =F (s), (6.38.7) 


where f‘—”) is the n™ anti-derivative of f defined by f{-"(t) = t dt, i 
dtn_—1-- ify (t,) dt;. Section 6.38.1 shows that the Laplace transform is an 
analytic function in a half-plane. Hence it has derivatives of all orders at any 
point in that half-plane. The next property shows that we can evaluate these 
derivatives by direct calculation. 


. Multiplication by powers of t: Let f be a locally integrable function whose 


Laplace integral converges absolutely and uniformly for Re s > a. Then F is 
analytic in Re s > o, and (forn = 0,1,2,..., with Re s > o) 


ces) =(-£) Fb) 


(ig) 19) o- Cd v 


where (t a)" is the operator (t) applied n times. 


(6.38.8) 


. Division by powers of t: If f is a locally integrable function of exponential 


type such that f(t) /t is a Laplace transformable function, then 


f© _[- 
Ic (@)| (s) =| F(u) du, (6.38.9) 
or, more generally, 


i<(4 tn ‘Vo -|- J fr (s1) ) ds, ds2 +++ d&n (6.38.10) 


is the n™ repeated integral. It follows from properties (7) and (9) that 


rf) a\liy—1 
~~ da || (s)=-— | F(u)du. (6.38.11) 
ji2e\|o—2) 


Periodic functions: Let f be a locally integrable function that is periodic with 
period 7’. Then 





T 
[L(f)] (s) = ay [ro Je~** dt. (6.38.12) 
0 





Hardy’s theorem: If f(t) = S379 ent” for t > 0 and )>r° ) 
0 
for some so > 0, then [L(f)] (s) = 7°, @! for Re s > so. 


n=0 5s” 


“! converges 
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6.38.3 INVERSION FORMULAS 
6.38.3.1 Inversion by integration 
If f(t) is a locally integrable function on [0, 00) such that 


1. f is of bounded variation in a neighborhood of a point to > 0 (a right-hand 
neighborhood if to = 0), 
2. The Laplace integral of f converges absolutely on the line Re s = c, then 


1 oe 0, if to < 0, 
aon / F(sjeds= 4 f(0+)/2 if to = 0, 
— 00 : 

car [F(to+) + f(to—)] /2. ifto > 0. 

In particular, if f is differentiable on (0, co) and satisfies the above conditions, then 
ctiT 
1 st 
jim 5 / F(s)e"ds = f(t), O<t<oo. (6.38.13) 
c—iT 


6.38.3.2 Inversion by partial fractions 


Suppose that F' is a rational function F(s) = P(s)/Q(s) in which the degree of 
the denominator @ is greater than that of the numerator P. For instance, let F' be 
represented in its most reduced form where P and Q have no common zeros, and 
assume that Q has only simple zeros at a1,..., @, then 





foj=f° Pep =c-* (53) (‘)=>- ath et (6.38.14) 
k=1 


EXAMPLE If P(s) = s—5and Q(s) = s?+6s+13, then a) = —3+2i, az = —3—2i, 
and it follows that 


pet s—5 (2i — 8) e(-3+2i)¢ (2i+8) (3-248 
ae (=a) - a_i eae 


=e *(cos 2t — 4sin 2t). 


6.38.4 CONVOLUTION 


Let f(t) and g(t) be locally integrable functions on [0,0o), and assume that their 
Laplace integrals converge absolutely in some half-plane Re s > a. Then the con- 
volution operation, x, associated with the Laplace transform, is defined by 


h(t) = (f xg)(t y= fs g(t—x)d (6.38.15) 


The convolution of f and g is a locally integrable function on [0, co) that is continu- 
ous if f or g is continuous. Additionally, it has a Laplace transform given by 


H(s) = (Lh) (s) = F(s)G(s), (6.38.16) 
where (£f)(s) = F(s) and (Lg)(s) = G(s). 
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6.39 MELLIN TRANSFORM 


The Mellin transform of the real function f(a) is 


f*(s) =M[f(z); 5] = I f(a)x*! de. (6.39.1) 


c+ioo 
Fle) =MOUf(s)sx] => [ fe(s)urPds. (6.39.2) 





6.40 Z-TRANSFORM 


The Z-transform of a sequence { f (n)}°°.., is defined by 


Z[f(n))=F(z)= So fine, (6.40.1) 
for all complex numbers z for which the series converges. 
The series converges at least in a ring of the form 0 < 11 < |z| < ro < ~, 
whose radii, 7 and r2, depend on the behavior of f(n) at -koo: 


ry =limsup V/|f(n)], rg = lim inf a (6.40.2) 
nevse mao VF) 

If there is more than one sequence involved, we may denote 7; and rz by ri(f) 
and r2(f), respectively. It may happen that 7; > r2, so that the function is nowhere 
defined. The function F(z) is analytic in this ring, but it may be possible to continue 
it analytically beyond the boundaries of the ring. If f(n) = 0 for n < 0, then 
ro = oo, and if f(n) = 0 for n > 0, then r; = 0. 

Let z = re’. Then the Z-transform evaluated at r = 1 is the Fourier transform 
of the sequence { f(n)}*, 








S> f(nje"*. (6.40.3) 


n=—Co 


6.40.1 EXAMPLES 


1. Let a be a complex number and define f(n) = a”, for n > 0, and zero 
otherwise, then 


Z[f(n)] = laze ™=—=— , |x| > Ia. (6.40.4) 


zZ—a 





n=0 
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Special case: step impulse function. If a = 1 then Z[u(n)] = “ i and 
Pus 
1, n>0, 
n) =u(n) = ; 
F(n) = u(n) {0 ie 
2. If f(n) = na”, for n > 0, and zero otherwise, then 
= nin az 
2[f(n)] =e A= Gap * |z| > lal. 
1, n= 0, —k 
3. Let d(n) = _ then Z[d(n—k)] = z—" fork = 0,41, +2,. 
0, otherwise, 


6.40.2 PROPERTIES 


The region of convergence of the Z-transform of the sequence { f(n)} will be de- 
noted Dy. 


1. Linearity: 
Zlaf(n)+bg(n)] = aZ[f(n)|+6Z[g9(n)| = aF (z)+bG(z), 2 € DeNDyg. 


The region D+ (| D, contains the ring 7; < |z| < rz, where 
ry = maximum {ri(f),71(g)} and rg = minimum {r2(f), r2(g)}. 

2. Translation: Z| f(n — k)] = z~* F(z). 

3. Multiplication by exponentials: Z|(a"f(n))] =  F(z/a) when 
lalri < |z| < alr. 

4. Multiplication by powers of n: For k = 0,1,2,...andz € Dr, 


k 
2[(n* f (n))] = (—1)* (4) F(z). (6.40.5) 


5. Conjugation: Z[f(—n)] = F (; 

6. Initial and final values: If f(n) = 0 for n < 0, then lim,_,. F(z) = f(0) 
and, conversely, if F(z) is defined for r; < |z| and for some integer m, 
lim, 300 2" F(z) = A (with A 4 +oo), then f(m) = A and f(n) = 0, 
forn < m. 

7. Parseval’s relation: Let F,G € L?(—7,7), and let F(z) and G(z) be the 
Z-transforms of { f(n)} and {g(n)}, respectively. Then 








SS f(njg(n) = = ‘ F(e™”)G(e™) du. (6.40.6) 
In particular, 
S- Ifn)2 = =| |F(e) |? dw. (6.40.7) 
20 Ja 
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6.40.3 INVERSION FORMULA 


Consider the sequences 








1, n=O -1l, n<0O 
n)=u(n)=4" ~~ and = —u(-—n-1)= 
Fin) = uln) i reg and a(n) = —u(—n 1) fs ee 
Note that F(z) = i for |z| > 1, and G(z) = 7 7 for |z| < 1. Hence, the 

z= z- 


inverse Z-transform of the function z/(z — 1) is not unique. In general, the inverse 
Z-transform is not unique, unless its region of convergence is specified. 


1. Inversion by using series representation: 
If F(z) is given by its series 


co 
F(z)= Se Qnz", T1<|z| <1, 


n=— Co 


then its inverse Z-transform is unique and is given by f(n) = a,, for all n. 

2. Inversion by using complex integration: 
If F(z) is given in a closed-form as an algebraic expression and its domain of 
analyticity is known, then its inverse Z-transform can be obtained by using the 
relationship 


f(n) = = ¢ F(z)2""1dz, (6.40.8) 
9 


207% 


where y is a closed contour surrounding the origin once in the positive 
(counter-clockwise) direction in the domain of analyticity of F(z). 

3. Inversion by using Fourier series: 
If the domain of analyticity of F’ contains the unit circle, |r| = 1, and if F is 
single valued therein, then F'(e’’) is a periodic function with period 27, and, 
consequently, it can be expanded in a Fourier series. The coefficients of the 
series form the inverse Z-transform of F’ and they are given explicitly by 

fa)= x - (ec )e'"? dO. (6.40.9) 

(This is a special case of (2) with y(@) = e’”.) 

4. Inversion by using partial fractions: 
Dividing Equation (6.40.4) by z and differentiating both sides with respect to 
z, results in 


Z[(z-a)*] = (" - ‘) a"—*u(n — k), (6.40.10) 


fork = 1,2,...and|z| > |a| > 0. Moreover, 


Z*[z-*] =d(n—k). (6.40.11) 
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Let F(z) be a rational function of the form 


F(z)= P(z) — an2N +...+a12 +49 
~~ Q(z) buzM@ +... 4 biz +b’ 


with an x O and bay x 0. 

(a) Consider the case N < M. The denominator Q(z) can be factored over 
the field of complex numbers as Q(z) = c(z — 21)*! +++ (z — zm)*™, 
where c is aconstant and k,..., km are positive integers satisfying ky + 
...+Kkm = M. Hence, F can be written in the form 








m ky 
F(2)=)) ah (6.40.12) 
w=1 g=1 
where 
1 dhi-j 
Aiz= Gp! jim at (( = JF (e)) . (6.40.13) 


The inverse Z-transform of the fractional decomposition Equation 
(6.40.12) in the region that is exterior to the smallest circle containing 
all the zeros of Q(z) can be obtained by using Equation (6.40.10). 


(b) Consider the case N > M. We must divide until F’ can be reduced to 
the form R(2) 
Zz 
PYG) = (2) + 
Q(z) 


where the remainder polynomial, R(z), has degree less than or equal to 
M — 1, and the quotient, H(z), is a polynomial of degree N — M. The 
inverse Z-transform of the quotient polynomial can be obtained by using 
Equation (6.40.11) and that of R(z)/Q(z) can be obtained as in the case 
N<M. 


EXAMPLE To find the inverse Z-transform of the function, 


245 
F(z) = GoD ~d)’ |z| > 2, (6.40.14) 
the partial fraction expansion, 
zA4+5 6 10 21 
Giga)"  Gaie e  @0) (6.40.15) 


is computed. With the aid of Equation (6.40.10) and Equation (6.40.11), 
Z~* [F(z)] = 6(n +1) + 46(n) — 6(n — 1)u(n — 2) 
—10u(n —1)421- 2” tu(n —1), (6.40.16) 


or f(n) = —6n — 44+ 21-2"~1, for n > 2, with the initial values f(—1) = 1, 
f(0) =4, and f(1) = 11. 
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6.40.4 CONVOLUTION AND PRODUCT 


The convolution of two sequences, {f(n)}°. and {g(n)}%., is a sequence 


{h(n)}°. defined by h(n) = 3 .. f(k)g(n — k). The Z-transform of the 
convolution of two sequences is the product of their Z-transforms, 
Z[h(n)] = Z[f(n)JZl9(n)], 
for z € Ds (| Dg, or H(z) = F(z)G(z). 
The Z-transform of the product of two sequences is given by 
1 z\ dw 
Z[f(n)g(n)] = aa f PWG (=)=. (6.40.17) 
nt J, ws w 


where 7¥ is a closed contour surrounding the origin in the positive direction in the 
domain of convergence of F'(w) and G(z/w). 


6.40.5 LINEAR CANONICAL TRANSFORMATION 
The Linear Canonical Transformation (LCT) of the function x(t), using the parame- 
ters {a, b, c,d} with ad — bc = 1, is defined to be 


71 


X(a,b,c,d)(U) = v=ieriawtle f exp [F(a + at)| x(t) dt whenb #40 


X(a,0,c,d) (t) = Video" x (du) when b = 0 
(6.40.18) 


[oe) 


e Many common integral transforms can be written in terms of the LCT: 


. a b) | 0 1 
1. Fourier Transform r ‘ = E i 
b ; i 
2. Fractional Fourier Transform . = ae @ sind 
c d —sin@ cosé 
a b 1 rz 
3. Fresnel Transform k “ = F i 
a b 0 7 
4. Laplace Transform k i = ? | 
5. Fractional Laplace Transform |“ ei a O  isin@ 
c d isin? —icosé 


e Composition of LCTs is equivalent to multiplying matrices. If the LCT opera- 
tion is written as X(q,5,c,a)(u) = Lya,p,c,a)|"(t)] then 


La,b,c,4) ° £(4,B,0,D) = L(a,8,7,8) (6.40.19) 


E | = b | é a (6.40.20) 


where 
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6.41 TABLES OF TRANSFORMS 


Finite sine transforms 


fs(n) i F(a) sinnadx, forn = 1,2,.... 
0 


eae ea 
Pierre [Rea 
Phere ee 


| aji-(-p"yn | 4fa—( - li-(-1y"—m 


nt ee 
Soin 
T—-2 ed 
(a (x? — x? a(n? —2?)/6r 


2 1-—(- — 


Te ll 


sinh c(7 — 2) 





sinh cm 


with k 4 0,1,2,. sin k(n ~ 2) 
~sinkr 


— when n = m 
sin mx 
whenn £m,m=1,2,.. 
Re 1 — (—1)" cos kr] eae 
ae 1,2,... @ifn=k) 


msinkx — xcosk(m— x) 


2k sin? kr 2k sin kr 


bsin x 


with |b] < 1 = tan 


1— bceosz 


aoe 
: 
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Finite cosine transforms 


fain) = f F(x) cosna dx, forn =0,1,2,.... 
0 


for0O<a< 7/2 
form/2<a<T 


cosh c(7 — x) 


~esinher 


with k £ 0,1,2,... 
ea ae ~ sinma 
_ cosk( (7 — 2) 
~ ksinkn — 


cos max (i, 2) en 
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Fourier sine transforms 


F(w) = F(f)(w) = er f(x) sin(wax) dz, w> 0. 


J2 [sin =O 





Fourier cosine transforms 


F(w) = F.(f)(w) = er f(x) cos(wa) dx, w> 0. 


2 sin aw 


Tv Ww 


sin{a(1—w)]| sin[a(1+w)] 
l-w + 1l+w 
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Fourier transforms: functional relations 


aj" dx 


Tal 


[sfesns) wae [zeae 
ce (2 





Fourier transforms 


F(w) = F(f)(w 


ax)je'** daz 


i ft 
F(w) 


5(") (zx) a Vin 


LL -aeS 0 T 
4|A 
Hepa ts a a 


x >0 
Cn 
i >a 
alo 
|x| >a sma) +w 
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Fourier transforms 


a ET 
phe i 
0 
11 px@r<gq Fen ara 
r<pc>q 
eo CE Tiax 0 
x<0 Vir(w+at ic) 


13 | e fem? Rep 0 fem? Rep 0 >0 tee 


Pelee = 
Pele vere | ye 


e~alel /, Ja] oe 


cosh ax 


F 2 cosh & 
2 cos $ cosh 5 
cosh 7x 


= 1 a TT p_speaieen Miao 
< < ) 7m cos a+cosh w 


sinh ax 1 sina 


JF Jo(aw) 





sin[bVa?+x?| ° |\w| >b 


|w] <b 
Fa Ins1/2(w) 


cos[bVa2—x?] 

Serial <a Ve Jo(aVw? + b) 
0 \a| >a 

cosh[bVa?—x? 

ae |z| <a J 5 Jo(avw? — b?) 


\a| >a 
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Multidimensional Fourier transforms 


F(u) = (Q2n)—"/? fof Feet ae 


7) Flu) 


In n-dimensions 


ras 
x) (27)” f(—u) 


Two dimensions: let x = 


aw wat" 


ei(au 


(x4 — a, lf@-ay-b) | 


Sf te (a LY) 
a 


ris fre —— 


< b ¢ 
7 \a| <a, (eecuingle) 2 sin au sin bu 
0 otherwise 
< 
\a| <a any 2sinau (v) 
0 otherwise 


1 
13 e+y’ <a? ae Thaw u* +7) 
0 otherwise Jue + ve 


Three dimensions: let x = (x, y, z yond = (u,v,w). 


—i(au+bu+cw) 
(27) one 


| ena/tenat/ae-P ike ag b,e > 0 | y? /4b— 2? /4e a, | ena/tenat/ae-P ike ag b,e > 0 | c>0 a —bu?—cw? 


16 F ? sin ausin a sin au sin bu sin cw cw 
0 Sa (box) 


pyre? <a? () = 








. (ball) V27p3 
0 otherwise 0 = 4? ea eae? 
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Hankel transforms 


O0<a<l 
l<2 
Rev >-1 


1/2 (2 rm a2)- 4/2, 


Rea>0O, Rev >-—1/2 


H1/2—an 


Rea>0O, Rev>-l 


2 
+1/2,—-ax , 





Rea>0O, Rev>-l 


Rea>0O, Rev>-l 


—¥-1/2 cos(az), 
a>0, Rev >-—1/2 
gi/?-” sin(az), 


a>0O, Rev>1/2 


or 


pa Ta (az), 


a>0, Rev >—3/2 





= | ah Tem Gidite 


DPT es Dah tery atl 


x Ivtp+l (ay) 





a(n) ye HPT y+ 3/2) 
x (a? hg? =P 872 


y’+1/2(2a)—-”—1 exp (—y?/4a) 

yeti (a2 + y%) — 

x (a2 + y2)-1/? 

Jra-ry VAD (y + 1/2) 

x (y? — a?)¥ 2A (y — a) 

Eas: ve al 
ye-3/2 Ay 


ava) y HA (y — a) 
Rev >—1 


O<y<a 


q7¥-l yerl2, 
0, a<y 
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Hilbert transforms 





i 


sin x 
1+2? 


1— cos(ax) = cos(a sin(a 


-= sgn(z) sin(a|a|'/?) a> 0 | cos( a ) + exp(—aly|!/?) 
ae ee 
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Laplace transforms: functional relations 


= [ $Ge Pde. 


ae oe 


[form fereiy 


sF(s) — F(0+) 


— sF(0+) — F'(0+) 


a 
7 ST 


Dee 





tk-1 


(nh) (q 
ett Y 
oe (n—k ie (k—1)! 
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Laplace transforms 


Fs) =£(N)(8) = f° Fle“ ae 


H(t), unit step function or | 4 /s 
Heaviside function 


( 


N 


| 
j=. 
~~ 
NW 


3 
B 


3 

BR 
e 

SS 
w 


2 
/Vs 

di 
3 7 


— 
— Nn & Ww 
bo 


— 
— 


-1 
aut 
at 
amet ee elaine 
a i 
Ey (ox) 
i rai a) 


15 | —Gree™+c—a)ell+(a—be™ ——__1____— (a,b, cdistinct) 


a—b)(b—c)(c—a (s—a)(s—b)(s—c) 
| 


k 
a 
( 


0 
3 





— 
Nn N 





1 
17 | cosat 
1 


= 
=| 
s 

1 


( 8 
Zags 
sat ra? 
é 1 
2—a 
ze(1 ~ cosa 
“(at ~ sinat) 
x (si ——! z 
44 A 7 


—a2 


N 
oO 


2 
2 


) ) 
a 


1 
a 
1 

1, 

1 
a 
1 
ao 

1 
2a 
t 
2a 


2 
3 





2 
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Laplace transforms 


P(s) = £(A)(8) = f * (then at. 


24 | +(sin at + at cos at) 1 


= n genes 
gn—Tp2n k=1 n—1 


Ss 








ew n gerard (=a8)P=* 
4n—Tp2n k=1 n—-1 k—1)! 
k 
x & [acos bt + bsinat] 


sn—1 /2n—k—2) (—2t)*7! 
2b ei ( yo) 





x on [sin b¢] 


—at 


_eat/2 (cos atv3 ost Beit atv3 





sin at sinh at 


5,2 (cosh at — cos at) 


+ at?) sin at — cosat 


2 


+ ae® ' erf(av‘t) red 





wt 
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Laplace transforms 


P(s) = £(A)(8) = f * (then at. 


1 2a ,—a2 vty 3 
1 at 1 
eer 
| am 
Vs(s+a?) 
b? — a? 


—beb*t erfc(bVt) (s = a?)(b te v/s) 


et erfc(ay#) Tw 


1 
s(/s 
a 
sta)/s+b 


ONE ot ie a 
FE=) 


b2 a2 
+¢eb"t erfe(byt) V8(s—a?)(/s+b) 


n! 
Salter ten ( vi) 





gt 





t ~ e7(atb)t/2 
a—b 


xIy—1j2 (4$%t) 








= k—1/2 
My (a) J-1/2(at) WaaF (k > 0) 
(res (> 0 


ak I;,(at) 


a k—-1/2 
4 (oh) e-ayalat) 
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Laplace transforms 


P(s) = £(N)(s) = [Fleer a. 
0 
a eC 
62 0 when0d<t<k 
1 whent>k 
63 when0<t<k 
t—k whent>k 
when0<t<k 
" ear =a whent>k (p > 0) 
65 1 eee: Lege 
QO whent a et k 
| 66] jsnath at| 


cos — 
cosh 2\/at 
sin 2\/at 


sinh 2 sei 


S| 
wn 
ios) 
l 
is} 
Se, 
wn 


i= 
— 
w 


: ace 
o 


2 I5h- 


H 
oo] 
Re 
re) 
a 


te 


_1(2Vat 
GU? 73 (Q,Jat) 


—a?/4t 


fo 
alo 
Sema 
= 
> 
= 
to 
— 
> 
=) 


Ny 
alo 
“" 


a 
Vv 


i=} 


a |e 
fl 7 
— 
a 
oO oO 


Fe 


=e 
Qt 


—a?/At 


bo 
a) 
oh 


e 


bo 
ape 
Au 
— 
8 
IV 
oO 


C 
te 


£ e74 214t aerfc g8/2e-aVs 


= 
(a + 2kt) ——- 


I’(1) —logt 


: =o 


e* aT a 


a 


= 





ale 
| 99 | 
) 
) 
> 0) 
exf 
) 
> 0) 
| 78 [est 
| 79 | 
| 80 | 
iG 
82 | ent 
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Laplace transforms 


P(s) = £(A)(8) = f * (then at. 


83 | cost Si(t - - =m ~ ~-— 


tlog s 
Psaicg ray) 


(et — ef) 


[at log a + sin at — at Ci(at)] 


(1 — cos at) 


2 
al 
2 
= ( 
2 
= ( 


(1 — cosh at) 


=a (a > 0) 


[5 - | cos s + Ci(s) sin s 


when0<t<a (as) 
—1/2 whent >a 





6.41. TABLES OF TRANSFORMS 531 


Mellin transforms 


f*(s) = M([f (x); 8] = i f(a)x>! da. 


ag(x) + bh(:r) ag*(s) + bh*(s) 

f(a) ? 

a” f™ (2)+ a 
Inf (yt (-1)" ts. 
Rigen) 0 Re 
(rs) 








e€ 


0 ™ cosec(7s) 0<Res<l 


j= 
+2)7} 
aie ey 
12 | log(1 + ax) largal <a ms *a~* cosec(7s) 
—1<Res<0 
aaa 
ax 
2 ¢ 
ax) 


0<Res<l 


— 
| 
8 


1 





Le o—-l apf 1 
13 | tan —37s~~ sec(578) 
—1<Res<0 


: 
: 
n 


18 K,( ~822-21'((s —v)/2) 
° xT((s+v)/2) Res>|Rev 


tAssuming that lim,_,94 2°"! f(x) = 0 forr =0,1,...,n—1. 
tWhere J,, denotes the n' repeated integral of f(x): Io f(x) = f(x), Inf(x) = 
io fade: 
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7.1 PROBABILITY THEORY 


7.1.1. INTRODUCTION 


A sample space S associated with an experiment is a set S of elements such that any 
outcome of the experiment corresponds to a unique element of the set. An event E is 
a subset of a sample space S'. An element in a sample space is called a sample point 
or a simple event. 


7.1.1.1 Definition of probability 


If an experiment can occur in n mutually exclusive and equally likely ways, and if 

exactly m of these ways correspond to an event F, then the probability of E is 
Pea, (7.1.1) 

n 

If E is a subset of S, and if to each element subset of S, a non-negative number, 

called the probability, is assigned, and if E is the union of two or more different sim- 

ple events, then the probability of H, denoted P(£), is the sum of the probabilities 

of those simple events whose union is FE. 

Technically, a probability space consists of three parts: a sample space S' (set 
of possible outcomes); a set of events {A} (an event contains a set of outcomes); 
and a probability measure P (a function on events such that P(A) > 0, P(S) = 1, 
and P (UjeyAj) = doje P(Aj) if {Aj | 7 € J} is a countable, pairwise disjoint 
collection of events). 


7.1.1.2 Marginal and conditional probability 

Suppose a sample space S' is partitioned into rs disjoint subsets where the general 
subset is denoted EF; 1 F; (with 2 = 1,2,...,r and 7 = 1,2,...,s). Then the 
marginal probability of E; is defined as 


Pim) = >. PU), (7.1.2) 
j=l 
and the marginal probability of F; is defined as 
P(F;)) = >> P(E, F)). (7.1.3) 
i=l 
The conditional probability of E;, given that F’; has occurred, is defined as 
P(E; 0 F;) 
P(E; | Fj) = PR) when P(F;) 40 (7.1.4) 
and that of F’;, given that ; has occurred, is defined as 
P(E, OF; 
P(F; | Ei) = ( v when P(E;) # 0. (71,5) 


P(Ei) ’ 
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1.3. Probability theorems 
. If (is the null set, then P(O) = 0. 


. If S is the sample space, then P(S) = 1. 
. If # and F are two events, then 


P(EUF) = P(£)+ P(F)- P(ENF). (7.1.6) 
. If F and F' are mutually exclusive events, then 
P(EUF) =P(E)+P(F). (7.1.7) 
. If Land E’ are complementary events, then 
P(E) =1—- P(E’). (7.1.8) 
. Two events are said to be independent if and only if 
P(ENF) = P(E) P(F). (7.1.9) 
The event F is said to be statistically independent of the event F’ if 
P(E | F) = P(E) and P(F'| E) = P(F). 
. The events {F),..., E,} are called mutually independent if and only if every 
combination of these events taken any number of times is independent. 
. Bayes’ rule: If {E,..., F,} are n mutually exclusive events whose union is 
the sample space S', and if F is any event of S' such that P(E) 4 0, then 
P(Ex) P(E | Ex) ——_ P( Ex) P(E | Ex) 


(7.1.10) 


. For a uniform probability distribution, 


Number of outcomes in event A 
PA) = TAAL 
(A) Total number of outcomes ( ) 


1.4 Terminology 


. A function whose domain is a sample space S' and whose range is some set 
of real numbers is called a random variable. This random variable is called 
discrete if it assumes only a finite or denumerable number of values. It is 
called continuous if it assumes a continuum of values. 

. Random variables are usually represented by capital letters (e.g., X, Y, Z). 

. “tid” or “iid? is often used for the phrase “independent and identically 
distributed.” 


4. Many probability distributions have special representations: 


(a) x2: chi-square random variable with n degrees of freedom 

(b) E(A): exponential distribution with parameter A 

(c) N(u,o): normal random variable with mean ;: and standard deviation 7 
(d) P(A): Poisson distribution with parameter 

(e) U[a, b): uniform random variable on the interval [a, b) 
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7.1.1.5 Characterizing random variables 
The density function is defined as follows: 

1. When X is a continuous random variable, let f(a) da denote the probability 
that X lies in the region [7,2 + da]; f(a) is called the probability density 
function. (We require f(x) > 0 and f f(a) dx = 1). Mathematically, for any 
event EF, 


P(E) = P(X isin E) = | f(x) dx. (7.1.12) 
E 
2. When X is a discrete random variable, let p;, for k = 0,1,... be the proba- 
bility that X = x, (with py, > O and SE pr = 1). Mathematically, for any 
event EF, 
P(E) = P(X isinE) = S© pp. (7.1.13) 
rpEE 
A discrete random variable can be written as a continuous density 


f(x) = So prd(w - 2x). 
k 


The cumulative distribution function, or simply the distribution function, is 


S- Dk in the discrete case, 
F(z) = P(X <x) = ¢ 3" (7.1.14) 
f(t) dt, in the continuous case. 
Note that F'(—oo) = 0 and F'(co) = 1. The probability that X is between a and 6 is 
Pla< X <b) =P(X <b) — P(X <a) = F(b) — F(a). (7.1.15) 


Let g(X) be a function of X. The expected value (or expectation) of g(X), 
denoted by E [g(X)], is given by (when it exists) 


E[g(X)] = (eee in the discrete case, (7.1.16) 


Jp g(t)f(t) dt, in the continuous case. 


1. E[aX + bY] = aE[X] + bE[Y]. 
2. E[XY] = E[X]E[Y] if X and Y are independent. 


The moments of X are defined by pj, = E|X*]. The first moment, j/, is 
called the mean of X; it is usually denoted by p = pi, = E[X]. The centered 
moments of X are defined by uz, = E [(x = y)*). The second centered moment is 
called the variance and is denoted by o? = juz = E[(X — 1)?]. Here, o is called 
the standard deviation. The skewness is 7, = [13/0°, and the excess or kurtosis is 
2 = (ua/o*) — 3. 

Using oe to denote the variance for the random variable 7, we have 
ee 
2. a2 1x = aa 
3. C2 gig = 07%: 


Oo 
l. oy =e 
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7.1.1.6 Generating and characteristic functions 


In the case of a discrete distribution, the generating function for the random variable 
X (when it exists) is given by G(s) = Gx(s) = E[s*] = 729 pes®*. From this 
function, the moments may be found from 


1, = (532) Glo 


. If cis a constant, then the generating function of c + X is s°G(s). 

. If cis a constant, then the generating function of cX is G(s°). 

3. If Z = X + Y where X and Y are independent discrete random variables, 
then Gz(s) = Gx(s)Gy(s). 

4. If Y = $0"_, Xj, the {X;} are independent, and each X; has the common 

generating function Gx (s), then the generating function of Y is [Gx(s)]”. 


117) 





s=1 


oe 


In the case of a continuous distribution, the characteristic function for the ran- 
dom variable X is given by ¢(t) =E ler] = a e''® F(x) da; the Fourier trans- 
form of f(a). From this function, the moments may be found: y/, = i~"@‘") (0). 
If Z = X + Y where X and Y are independent continuous random variables, then 
z(t) = dx (t)dy (t). The cumulant function is defined as the logarithm of the char- 
acteristic function. The n”” cumulant, k,,, is defined as a certain term in the Taylor 
series of the cumulant function, 


log ¢(t) = ye (7.1.18) 


n=0 





Note that kK, = pl, Kg = 07, K3 = fg, and K4 = jg — 3y3. For a normal probability 
distribution, «,, = 0 for n > 3. The centered moments in terms of cumulants are 





H2 = Ka, 
M3 = 43, 


(7.1.19) 
[a = Ka + 345, 





[5 = K5 + 10K3K2, 


For both discrete and continuous distributions, the moment generating function 
(when it exists) for the random variable X is given by G(t) = Gx(t) = E[e™*]. 


(For a multi-dimensional random variable: G(t) = Gx(t) = E le] .) The n® 
moment is then given by yu), = — 


7.1.2 CENTRAL LIMIT THEOREM 


If {X;} are independent and identically distributed random variables with mean ju 

and finite variance o”, then the random variable 

(X, + Xo 4+---+X,) — ny 
Jno 


tends (as n — oo) to anormal random variable with mean zero and variance one. 


Z= (7.1.20) 
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7.1.3 MULTIVARIATE DISTRIBUTIONS 
7.1.3.1 Discrete case 


The k-dimensional random variable (X1,..., X,) is a k-dimensional discrete ran- 
dom variable if it assumes values only at a finite or denumerable number of points 
(a1,...,U). Define 


P(X => 11,X2 = 12,.-. .,Xk = Lk) = f (x1, @2,- ee Xk) (7.1.21) 


for every value that the random variable can assume. The function f(21,..., 2%) is 
called the joint density of the k-dimensional random variable. If E is any subset of 
the set of values that the random variable can assume, then 


P(E) = P[(X),...,X,) isin E] = DF (eis---s te) k (7.1.22) 


where the sum is over all the points (a1,...,2,) in £. The cumulative distribution 
function is defined as 


F(a1,22,...,2%) = a x; ps > f (215 Za, ++ +5 Zk): (7.1.23) 


21521 Z2< a2 ZkeLUk 


7.1.3.2 Continuous case 


The & random variables (X1,..., X,) are said to be jointly distributed if a function 
f exists so that f(a1,...,2%) > 0 forall —co < aj < 00 (i = 1,...,k) and so that, 
for any given event EF, 
P(E) = Pi(X1, Xe,..., Xx) isin FE] 
as f § (41, 02,...,U~) dx, dxg +++ dx z. (7.1.24) 
The function f(a1,...,@%) is called the joint density of the random variables X, 
Xo9,..., X;. The cumulative distribution function is defined as 


© wo Lh 
Plaita,..524) = f / | f (21, 22, +++; 2k) dzp +++ dzg dz. (7.1.25) 


Given the cumulative distribution function, the probability density may be found 
from 
0 0 0 


f (x1, £2, rer Xk) = Ozr1 Ota 8 $8; Bagh eis os .; 2h). (7.1.26) 


7.1.3.3 Moments 


The r* moment of X; is defined as 


ae - as xt f(a1,..-,2k), in the discrete case, 
E[xX7]=< & co ‘ ; 
7 f wee Ai xt f(a1,...,@-) dx, --- dx, in the continuous case. 


—co —cCo 
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Joint moments about the origin are defined as E [Xy'X4? ---X;,"| where r) + r2 + 
--. + rz is the order of the moment. Joint moments about the mean are defined as 
E [(Xy — pir)" (Xa — fiz)" +++ (Xk — be)”*), where p_ = E[Xz] - 


7.1.3.4 Marginal and conditional distributions 


If the random variables X,, X2, ..., Xx have the joint density function 
f(x1,%2,...,@%), then the marginal distribution of the subset of the random vari- 
ables, say, X1, X2,..., Xp (with p < k), is given by 


Nt, £9, ee Pp) = 
sr Dini wee ee f(a1,%2,...,@%), in the discrete case, 
20 °** “oo (7.1.27) 
foun J f(wi,..., 2%) dvp41 +++ dx_, in the continuous case. 
—oo —oo 


The conditional distribution of a certain subset of the random variables is the 
joint distribution of this subset under the condition that the remaining variables are 
given certain values. The conditional distribution of X1, Xo, ..., Xp, given Xp+1, 
X05 0005 Ahs 1S 


Fig ay 2 BK) 


eee (7.1.28) 
G(Lpt1,Lp+2,-+--,Lk) 


Ca ee | Metiydsi4 Vb) = 
if 9(@p41,Tp42,---,Tk) #0. 
The variance oj; of X; and the covariance o;; of X; and X; are given by 
oi, = oF =H [(X; — pi)" , 
‘ (7.1.29) 
5; = pigtiog = E[(Xi — pi)(Xj — wy), 
where pj; is the correlation coefficient, and o; and 0; are the standard deviations of 
X; and X;. The following figures show data sets with varying correlation coeffi- 
cients, from left to right: p = 0.086, p = 0.28, p = —0.71, p = 0.99. 
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Numerical information alone, such as correlation values, can be misleading. The 
following 4 data sets (Anscombe’s quartet), each with 11 values, all have p = 0.82. 
(They also have, to many decimal places, the same mean in x, mean in y, best fit 
straight line, and several other parameters.) 
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7.1.4 AVERAGES OVER VECTORS 


Let f (nm) denote the expectation of the function f as the unit vector n varies uniformly 
in all directions in three dimensions. If a, b, c, and d are constant vectors, then 
la-nl? = lal? /3, 
(a-n)(b-n) = (a-b)/3, 
(a-n)n = a/3, 
la xn)? =2lal? /3, 
(ax n)- (bx n) = 2a-b/3, 
(a-n)(b-n)(e-n)(d-n) = [(a-b)(€-d) + (a-e)(b-d) + (a-d)(b-e)] /15. 


(7.1.30) 


Now let f(m) denote the average of the function f as the unit vector n varies uni- 
formly in all directions in two dimensions. If a and b are constant vectors, then 


la- nl? = |al? /2, 
(a-n)(b-n) = (a- b)/2, (7.1.31) 
(a-n)n = a/2. 


7.1.5 TRANSFORMING VARIABLES 


1. Suppose that the random variable X has the probability density function 
fx (a) and the random variable Y is defined by Y = g(X). If g is measurable 
and one-to-one, then 


Pia) F aise 


where h(y) = g~'(y). 
2. If the random variables X and Y are independent and if their densities f and 


fy. respectively, exist almost everywhere, then the probability density of their 
sum, Z = X + Y, is given by their convolution, 


fz(z) = i fx (a) fy (z — x) dz. (7.1.33) 


3. If the random variables X and Y are independent and if their densities fx and 
fy. respectively, exist almost everywhere, then the probability density of their 
product, Z = XY, is given by the formula, 


falz) = [- Sta) ee (=) de. (7.1.34) 


-co || 
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INEQUALITIES 


Markov inequality: If X is a random variable which takes only non-negative 
values, then for any a > 0, 
E[X] 


P(X >a)< 
a 





(7.1.35) 


. Cauchy-Schwartz inequality: Let X and Y be random variables for which 


E[X?| and E [Y?] exist, then 
(E[XY])? <E[X?] E[Y?]. (7.1.36) 


. One-sided Chebyshev inequality: Let X be a random variable with zero mean 


(ie., E[X] = 0) and variance o?. Then, for any positive a, 


P(X >a)< 


———. TEAST 
~ g2 + a? ( ) 


. Chebyshev inequality: Let c be any real number and let _X be a random variable 


for which E |(X — c)?] is finite. Then, for every € > 0 the following holds: 


P(|X —c| >) < 35 [(X — c)?]. (7.1.38) 


. Bienaymé-Chebyshev inequality: If E [|X |"] < co for all r > 0 (r not neces- 


sarily an integer) then, for every a > 0, 


P(|X|>a)< ete (7.1.39) 


| 
a” 


. Generalized Bienaymé—Chebyshev inequality: Let g(a) be a non-decreasing 


non-negative function defined on (0, 00). Then, for a > 0, 


E[g(iX)) 


P(|X|>a)< a 


(7.1.40) 


. Chernoff bound: This bound is useful for sums of random variables. Let 


Yn = oj;-1 Xi where the {X;} are iid. Let M(t) = E,[e’*] be the com- 
mon moment generating function for the {X;}, and define g(t) = log M(t). 
Then (the prime in this formula denotes a derivative), 


P(Y,>ng'(t)) < en rl’O-9] itt >o, 
P(Yn <ng(t)) < enlO-9], itt so. 
. Kolmogorov inequality: Let X1, X2, ..., X» be n independent random vari- 


ables such that E |X;] = 0 and Var(X;) = o%, is finite. Then, for all a > 0, 


n 9 
oO; 
P( max |Xi + X2+---+Xil >a) Sg (7.1.41) 


QT sivas n 


. Jensen inequality: If E[X] exists, and if f(a) is a convex U (“convex cup”) 


function, then 
E[f(X)| = f(E[X)). (7.1.42) 
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7.1.7 GEOMETRIC PROBABILITY 


I, 


Points in a line segment: If A and B are uniformly and independently 
chosen from the interval [0, 1), and X is the distance between A and B (that 
is, X = |A— B)) then the probability density of X is fx (x) = 2(1— 2). 


. Many points in a line segment: Uniformly and independently choose n—1 


random values in the interval [0, 1). This creates n intervals. 


P;,(x) = Probability (exactly & intervals have length larger than 2) 


= (") {tt — ka|"-} — (" A *) [l—(k+1)2]"-!+ (7.1.43) 
n+ cae(S)n-Gtaje}, 


1 
where s = F a K . From this, the probability that the largest interval length 
x 


exceeds x is 


1 Pie) = (") (1—2)?-1 — (5) (1—2a)"24+.... (7.1.44) 


. Points in the plane: Assume that the number of points in any region A of 


the plane is a Poisson variate with mean \A ( is the “density” of the points). 
Given a fixed point P define R,, Ro, ..., to be the distance to the point nearest 
to P, second nearest to P, etc. Then 


fri(r) = eR reteset (7.1.45) 


. Points in three-dimensional space: Assume that the number of points in 


any volume V is a Poisson variate with mean AV (A is the “density” of the 
points). Given a fixed point P define R;, Ro, ..., to be the distance to the 
point nearest to P, second nearest to P, etc. Then 


3 (4Ar)* 


3s—1 —4\rr8 7.1.46 
TCs) if € : (7.1.46) 


fri(r) = 


. Points on a checkerboard: Consider the unit squares on a checkerboard 


and select one point uniformly and independently in each square. The follow- 
ing results concern the average distance between points: 


(a) For adjacent squares (a black and white square with a common side) the 
mean distance between points is 1.088. 

(b) For diagonal squares (two white squares with a point in common) the 
mean between points is 1.473. 


. Points in a cube: Choose two points uniformly and independently within 


a unit cube. The distance between these points has mean 0.66171 and standard 
deviation 0.06214. 
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7. Points in an n-dimensional cube: Let two points be selected uniformly 
and independently within a unit n-dimensional cube. The expected distance 
between the points, A(n), is 


e A(1) = 3 e A(5) © 0.87852 
e A(2) + 0.54141 e A(6) = 0.96895 
e A(3) ¥ 0.66171 e A(7) © 1.05159 
e A(4) © 0.77766 e A(8) = 1.12817 
8. Points on a circle: Select three points uniformly and independently on 


a unit circle. These points determine a triangle with area A. The mean and 
variance of the area are: 


LA = a ~ 0.4775 
20 


7.1.47 
a SAE = 8) sq iamy oe 
OA = 8r2 ~ Uz. 
9. Buffon needle problem: A needle of length L is randomly placed on a 


plane on which has parallel lines a distance D apart. If = < 1 then only one 
intersection is possible. The probability P that the needle intersects a line is 


QL 
Casha io< LD 
=D 1 = Sv, 

P=) or DS 2 D 
ap Le \-(2) + (1-252) Troe D = L, 

(7.1.48) 


7.1.8 | RANDOM SUMS OF RANDOM VARIABLES 


If T = ue X;, and if N is an integer-valued random variable with generating 
function G'y(s), and if the {X;} are discrete independent and identically distributed 
random variables with generating function G'x(s), and the {X;} are independent 
of N, then the generating function for T is Gr(s) = Gn(Gx(s)). (If the {X;} are 
continuous random variables, then ¢7(t) = Gin (x (t)).) Hence, 


Ll. ur = UNEX. 
2. of, = pnot + p07. 


EXAMPLE A game is played as follows. A fair coin is flipped until a tail shows up and 
then the game stops. When a head appears, a die is rolled and the number shown is the 
number of dollars paid. What is the amount expected to be paid playing this game? 

1. The number of coin flips, NV, has a geometric distribution so that the expected number 
of flips is un = pnips = 2. 

2. The average return for the die is wx = [die = z (14+2+---+6)= Z. 

3. Hence the expected return is wr = [Unips/ldie = 7; or $7 per game. 
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7.2 CLASSICAL PROBABILITY PROBLEMS 


7.2.1. BIRTHDAY PROBLEM 
The probability that n people have different birthdays (neglecting February 29") is 


364 363 366 —n 
m=l(s—]-(==]-:: 7.2.1 
: (=) (=) ( 365 ) we 
Let p, = 1 — qn. For 23 independent people the probability of at least two people 
having the same birthday is more than half (p23 = 1 — q23 > 1/2). 





n 10 20 23 30 40 50 


Pn 0.117 0.411 0.507 0.706 0.891 0.970 


That is, the number of people needed to have a 50% chance of two people having 
the same birthday is 23. The number of people needed to have a 50% chance of three 
people having the same birthday is 88. For four, five, and six people having the same 
birthday the number of people necessary is 187, 313, and 460. 

The number of people needed so that there is a 50% chance that two people 
have a birthday within one day of each other is 14. In general, in an n-day year the 
probability that p people all have birthdays at least k days apart (so that k = 1 and 
p = 2 is the original birthday problem) is 


L. ! 
probability = (" nie - ‘) te (7.2.2) 
= 








7.2.2 COUPON COLLECTORS PROBLEM 


There are n coupons that can be collected. Random coupons are selected, with 
replacement. How long must one wait until they have a specified collection of 
coupons? 

Let W,,,; be the number of steps until 7 different coupons are seen; then 


J j : 
1 i-1 
i=1 


i= 


When j = n, then all coupons are being collected and E{W,,.,] = nH» with H, = 
141/2+1/3+---+1/n. Asn 00, E[Wnm] ~ nlogn +n + 3. 
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7.2.3 CARD GAMES 


7.2.3.1 Poker hands 
The number of distinct 5-card poker hands is () = 2,598,960. 


[| ere carts eat 5 of Fears 

|Hand = =~—_{ Probability Odds | Probability | Odds 
royal flush 1.54 x 10-® 649,739:1 | 0.00031 3,226:1 
straight flush | 1.39 x 10~° 72,192:1 | 0.0017 588:1 
four of akind | 2.40 x 1074 4,164:1 | 0.026 38:1 


full house 1.44 x 10-3 693:1 | 0.030 33:1 
flush 1o7 x 10-* 508:1 | 0.046 22:1 
straight 3.92 x 1078 254:1 | 0.048 21:1 
three of a kind | 0.0211 46:1 | 0.235 4.2:1 
two pair 0.0475 20:1 | 0.438 2.3:1 
one pair 0.423 1.37:1 | 0.174 5.7:1 





There are 7,462 distinct 5-card poker hand equivalence classes.' For the equiv- 
alence classes a royal flush is counted once, not 4 times. Similarly, when choosing 
the best 5 cards in 7-card poker, there are 4,824 equivalence classes. There are fewer 
than 7,462 equivalence classes because some hands cannot be the best 5 of 7 cards; 
for example, a high card hand where the highest card is a 7. 


[Hand | Unique | Distinet | Best 5 of 7] 
royal Mush 
i277 
10 
373 
763 
1470 
407 


For multiple players, each with their own cards, the probability of the winning 
hand (the one that is the best among all players) is shown below. An «€ represents a 
probability less than 0.0001, or 1 in ten thousand. For example when 5 people are 
playing poker the winning hand will be one pair 63% of the time. 





'Two poker hands are in the same equivalence class if, when playing poker, the hands would be tied. 
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OC 
three ofakind [0.08 [006 [008 [0.10 [012 [014 [014 [0.16 — 
Fwopair [009 [013 [016 [019 [022 [024 [026 [028 
Fone pair [0.60 [066 [0.67 [063 [0.00 [0s7 [034 [049 
Phish card [026 [0.12 [0.06 [00s [0.02 [0009 [0.005 [0.002 


ee 
full house 
fash foe [oos [ort [013 fous [016 | 
fos fort [ors [ora fous [os | 
031 
high card 
7.2.3.2 Poker with wild cards 


Using wild cards in poker leads to a paradox. The usual hierarchy of poker hands 
(straight flush, four of a kind, full house, flush, straight, three of a kind, two pair, one 
pair, high card) corresponds to the likelihood of those hands appearing. 

Assume that 1 or 2 jokers are added to a deck and that they are wild (so the 
deck has either 53 or 54 cards). The number of possible 5-card hands is now (2) = 
2, 869, 685 or (2) = 3, 162,510. The distribution of these hands when the wild card 


is used to make the best possible hand in the usual hierarchy is 


[Hand | one joker | two jokers) 





TOTAL 2,869,685 | 3,162,510 
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In each case, three of a kind is more likely than two pair. Hence, two pair is 
more rare and should be a rated higher than three of a kind; the hierarchy could be 
changed to reflect this. Then, the hand 9973W (i.e., 2 nines, a seven, a three, and a 
wild card) would be considered to be two pair (i.e., wild card is a seven) rather than 
three of kind (i.e., wild card is a nine). 

Unfortunately, when assigning all the hands in this revised hierarchy, the number 
of hands with three of kind is now fewer than the number of hands with two pair. So 
this revised hierarchy is also inconsistent. 


7.2.3.3 Bridge hands 


The number of distinct 13-card bridge hands is Ci = 635,013,559,600. 

In bridge, the honors are the ten, jack, queen, king, or ace. Obtaining the three 
top cards (ace, king, and queen) of three suits and the ace, king, queen, and jack of 
the remaining suit is called /3 top honors. Obtaining all cards of the same suit is 
called a /3-card suit. Obtaining 12 cards of the same suit with ace high and the 13th 
card not an ace is called a 12-card suit, ace high. Obtaining no honors is called a 
Yarborough. 


Hand Probability Odds 
13 top honors 6.30 x 107!?  158,753,389,899:1 
13-card suit 6.30 x 10712 158,753,389,899: 1 
12-card suit, ace high 2.72 x 10-9 367,484,698: 1 
Yarborough 5.47 x 1074 1,827:1 
four aces 2.64 x 1073 378:1 
nine honors 9.51 x 1073 104:1 


Assign card points as follows: ace=4, king=3, queen=3, and jack=2. Then each 
hand has an aggregate number of points. For a random hand let P be the probability 
of obtaining N points and let C' be the probability of obtaining at least N points. 

The likelihood of obtaining a hand with a specified number of points is below. 
For example, the probability of getting 15 points is 4.4% and the probability of get- 
ting 15at least points is 14.2%. 


Shae eS 
Saree 
ets 
Cea 


popoosar[OssiT] bare 
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Each bridge hand may have | to 4 different suits. The distribution of suits can 
be represented as A-B-C’-D where A is the number of cards in the longest suit and 
D is the number of cards in the shortest suit. For example, 4-3-3-3 means that the 
longest suit has 4 cards, and there are 3 cards in each of the other 3 suits. 

The probability of each possible suit distribution is shown below. The most 
common distribution is 4-4-3-2 which occurs 22% of the time. 


probability 

6.30 10= 
0.000000003 
0.000001 
0.000002 
0.000013 
0.000011 
0.000004 


0.00010 


0.000082 


0.00018 
0.000031 
0.00045 





0.0011 
0.0012 
0.0019 


0.000010 





7.2.4 DISTRIBUTION OF DICE SUMS 


When rolling two dice, the probability distribution of the sum is 


6—|s—7| 


Prob (sum of s) = 36 


for2<s<12. (7.2.4) 


When rolling three dice, the probability distribution of the sum is 


i 3(s — 1)(s — 2) for3<s <8 
Prob (sum of s) = 216 —s? + 21s — 83 for9<s<14 (7.2.5) 
4(19—s)(20—s) forl5<s<18 


For 2 dice, the most common roll is a 7 (probability z). For 3 dice, the most 
common rolls are 10 and 11 (probability s each). For 4 dice, the most common roll 
is a 14 (probability 4). 

Sicherman dice have sides {1, 2, 2,3,3,4} and {1,3,4,5,6,8}. The distribution 
of values obtained from rolling these two dice and adding the values is the same as 
the distribution of the sum of two “regular” dice ({1, 2,3, 4, 5, 6}). 


550 CHAPTER 7. PROBABILITY AND STATISTICS 


7.2.5 GAMBLER’S RUIN PROBLEM 


A gambler starts with z dollars. At each iteration the gambler wins one dollar with 
probability p or loses one dollar with probability g (with p+ q = 1). Gambling stops 
when the gambler has either A dollars or zero dollars. 

If g, denotes the probability of eventually stopping with A dollars (““gambler’s 


success’’) then 
(q/p)4 — (a/p)? 


ifpA#4q, 
(q/p)4 —1 
= (7.2.6) 
z , 
1- a ifp=q= 4. 


For example: 





0.5 0. 1 
fair| 0.5 0.5 | 90 100 
games |0.5 0.5] 900 1000 
0.5 0.5 | 9000 10000 | .900 


biased | 0.4 0.6 | 90 100 O17 
games | 0.4 0.6 | 90 99 .667 
7.2.6 GENDER DISTRIBUTIONS 


For these problems, assume there is a 50/50 chance of male or female on each birth. 


1. Hospital deliveries 


Every day a large hospital delivers 1,000 babies and a small hospital delivers 
100 babies. Which hospital has a better chance of having the same number of 
boys as girls? 

Answer: The small one. If 2n babies are born, then the probability of an even 
split is eG a This is a decreasing function of n. 


2. Family planning 


Suppose that every family continues to have children until they have a girl, 
then they stop having children. After many generations of families, what is 
the ratio of males to females? 


Answer: The ratio will be 50-50; half of all conceptions will be male, half 
female. 


3. If a person has two children and the older one is a girl, then the probability 
that both children are girls is 4. 


4. If a person has two children and at least one is a girl, then the probability that 
both children are girls is z. 
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7.2.7. MONTE HALL PROBLEM 


Consider a game in which there are three doors: one door has a prize, two doors 
have no prize. A player selects one of the three doors. One of the two unselected 
doors is opened and shown that it does not contain the prize. The player is then 
allowed to exchange their originally selected door for the remaining unopened door. 
To increase the chance of winning, the player should switch doors: without switching 
the probability of winning is 1/3; by switching the probability of winning is 2/3. 


7.2.8 NON-TRANSITIVE GAMES 


A non-transitive game has strategies which produce “loops” of preferences. For 
example, “rock-paper-scissors” is a non-transitive game. 


1. Bingo cards 


Consider the 4 bingo cards shown below (labeled A — D). Two players each 
select a bingo card. Numbers from | to 6 are randomly drawn without re- 
placement. If a selected number is on a card, it is marked. The first player to 
complete a horizontal row wins. Probabilistically, card A beats card B, card 
B beats card C,, card C beats card D, and card D beats card A. 


A B C D 
cfd Gta GE 
[5/6 | 2/6 | 


2. Efron’s Dice For 3 dice with the sides 


e A= {3,3,5,5,7,7} 
e B= {2,2,4,4,9,9} 
e C= {1,1,6,6,8,3} 


it turns out that die A beats die B, die B beats die C’, and die C beats die A. 
(“Beats” means “has a greater chance of winning”’.) 


3. Schwenk’s Dice For 3 dice with the sides 


e A=({1,1,1,13, 13, 13} 
e B = {0,3,3, 12, 12, 12} 
e C= {2,2,2,11, 11,14} 


it turns out that die A beats die B, die B beats die C’, and die C beats die A 
(all with probability 75). However, if the dice are rolled twice and the values 
added, then 2 of die A beats 2 of die C’, 2 of die C' beats 2 of die B, and 2 of 
die B beats 2 of die A. 
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7.2.9 ODDS OF WINNING THE LOTTERY 


Consider a lottery in which a player chooses N values, without repetition, from the 
numbers 1, 2,..., 1/. Then the winning N values are chosen, without repetition, 
from among the numbers 1, 2, ..., 4/. The number of ways to obtain & matching 
values is (77) (44) ). The number of possible player choices is (\Y). The probability 


of having exactly & values match is the ratio of these two numbers. 


EXAMPLE Ina “6/49” lottery, N = 6 number are chosen from M = 49 possibilities. 
The probabilities are as follows: 


1. no numbers match (k/ = 0); probability = (6) ( . )/( | = 0.4360 

2. exactly k = 1 number matches; probability = C) C) / () = 0.4130 

3. exactly k = 2 numbers match; probability = (C) ee / (2) = 0.1324 

4. exactly k = 3 numbers match; probability = (°) (%) / Cy) =~ 0.0177 

5. exactly k = 4 numbers match; probability = (§) (%°) / Ce) = 0.00097 

6. exactly k = 5 numbers match; probability = (2) (“) / ee =~ 0.000018 
7. all k = 6 numbers match; probability = (°) Cot) 7.1 x 1078 


7.2.10 RAISIN COOKIE PROBLEM 


A baker creates enough cookie dough for C' = 1000 raisin cookies. The number of 
raisins to be added to the dough, R, is to be determined. 


1. If you want to be 99% certain that the first cookie will have at least one raisin, 
then 1 — (S54)" =1- (2%)" > 0.99, or R > 4,603. 

2. If you want to be 99% certain that every cookie will have at least one raisin, 
then CP? OP 5 (S)(-1)*(C — i)® > 0.99. Hence R > 11, 508. 


7.2.11. WAITING PROBLEM 


Assume two people arrive at a meeting place randomly and uniformly between 1 
and 2 P.M. If person 7 waits w; (as a fraction of an hour) before they leave, then 
the probability that the two people will be at the same place at the same time is: 


2 4.2 
Pp = (wi +m) — “tt 





. For three people the probability of them all meeting is 
_ i 2 2 2, 13 13 
Pz = (wi w2 + wiw3 + w2UW3) 5 (wi w5 + wyw3 + w2W3) zu 52 


For n people all waiting w, the probability is P, = nw”—! — (n — 1)w 
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FIGURE 7.1 

Comparison of a binomial distribution and the approximating normal distribution. Left figure 
is for (n = 8,6 = 0.2), right figure is for (n = 8,0 = 0.5); horizontal axis is x. Only use 
the normal approximation for large n. 


0.3 
0.3 0.2 
0.2 
mk 
0.1 
0 0 
0 1 2 3 4 5 0 12 3 4 5 6 7 8 


7.3.1 DISCRETE DISTRIBUTIONS 


1. Bernoulli distribution: This is a special case of the binomial distribution with 
nm = 1. Example: flipping a coin that has a probability p of coming up heads. 

2. Binomial distribution: If the random variable X has a probability density func- 
tion given by 


P(X =2)=f(x)= (") p*(1—0)"-*, fore =0,1,...,n, (7.3.1) 


then the variable X has a binomial distribution. Note that f(x) is the general 
term in the expansion of [0 + (1 — @)]|”. 
Properties: 

Mean = p = 0, 


Variance = 0? = n6(1 — 8), 


Standard deviation = ¢ = \/n0(1 — 9), 


Moment generating function = G(t) = [0e’ + (1 — 0)]”. 


(7.3.2) 


As n —> oo the binomial distribution approximates a normal distribution with 
a mean of n@ and variance of n6(1 — 6); see Figure 7.1. 

3. Discrete uniform distribution: If the random variable X has a probability den- 
sity function given by 


P(X =2)=f(«)=-, for © = ©1,%2,.--,2n,; (7.3.3) 


then the variable X has a discrete uniform probability distribution. 
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Properties: When x; = 1 for? = 1, 2,...,n then 








1 
Mean = ph = us 5 
2 
2 
-—1 
Variance = 0? = ~ ; 
12 
5) (7.3.4) 
ae n?—1 
Standard deviation = ¢ = 7 
t _ nt 
Moment generating function = G(t) = eae) 
n(1— et) 


4. Geometric distribution: If the random variable X has a probability density 
function given by 


PX =e =fe)=00-o* fore —1,2,3,..., (7.3.5) 


then the variable X has a geometric distribution. 
Properties: 





1 
M — — =. 
ean = [UL 5 
1-0 
Variance = 07 = pz 
1_0 (7.3.6) 
Standard deviation = 0 = aE 
Moment ting function = G(t) ue 
oment generating function = SS 
= . T—e(1 6) 


5. Hypergeometric distribution: If the random variable X has a probability den- 
sity function given by 


(a) (aca) 
(n) 


then the variable X has a hypergeometric distribution. 


P(X =2)=f(«) = forz = 1,2,3,...,min(n, k) (7.3.7) 


Properties: 
M kn 
ean = p = — 
bb N? 
; k(N — k)n(N — n) 
aA = 
Variance = 0~ = ~ N2(N—-1) ” (7.3.8) 
Standard deviation = 0 = nats Gee 
N?2(N — 1) 
6. Multinomial distribution: If a set of random variables _X,, Xo,..., Xp, has a 


probability function given by 
P(X = r1,X2 = LS finds Noy = in) = f (x1, %2,..-,%n) 


n pri 
NU 


i=1 


(7.3.9) 
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where the {;} are positive integers, each 6; > 0, and 


Y= 1 and ) a= N, (7.3.10) 

i=1 i=1 
then the joint distribution of X1, X2, ..., Xn is called the multinomial 
distribution. Note that f(v1,7v2,...,%p) is a term in the expansion of 
(0) +02 +-+-+On)%. 
Properties: 

Mean of X; = pu; = NOj, 

Variance of X; =g) = N6,(1— 4;), are 
Covariance of X; and X; = oF = —N6,6;, ere 


Joint moment generating function = (0,e"' + --- + One’). 
. Negative binomial distribution: If the random variable X has a probability 
density function given by 
—1 
Joao for x = 0,1,2,..., 


(7.3.12) 
then the variable X has a negative binomial distribution (also known as a Pas- 
cal or Polya distribution). 


Properties: 
Mean = p = — 
ean = fl = an r, 

1 1-¢@ 

Variance = 0? = 7 (= ~1) _ r( z y 
(7.3.13) 
Snidsdnionea ood | aq 
andard deviation = a\@ = a 


Moment generating function = G(t) = 6"[1 — (1—@)e"|~”. 
. Poisson distribution: If the random variable X has a probability density func- 
tion given by 

aie 


x!) 





P(X =2)=f(z)= for x = 0,1,2,..., (7.3.14) 


with \ > 0, then the variable X has a Poisson distribution. 
Properties: 
Mean = p = 4, 
Variance = a? = 4, 
Standard deviation = o = V 
erle'-1) ; 


(7.3.15) 


| 


Moment generating function = G(t) = 
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7.3.2 CONTINUOUS DISTRIBUTIONS 


1. Normal distribution: If the random variable X has the density function 





1 = 2 
f(x) = exp Veer : for -—co <4 < oO, (7.3.16) 
river 202 
then the variable X has a normal distribution. 
Properties: 
Mean = p, 


Variance = er 
Standard deviation = oa, (7.3.17) 


242 
Moment generating function = G(t) = exp (ut + ) . 


(a) Set y = = to obtain a standard normal distribution. 
(b) The cumulative distribution function is 


F(x) = (2) = = i. exp (SS) dt. 


2. Multi-dimensional normal distribution: 
The random vector X is a multivariate normal (or a multi-dimensional normal) 
if and only if the linear combination a’X is normal for all vectors a. If the 
mean of X is ju, and if the second moment matrix R = E [(X — p)(X — p)"] 
is non-singular, the density function of X is 


1 1 ee 
f(x) = (Qny?\/det R exp 5 pe) R(x W) ; (7.3.18) 


Sometimes integrals of the form J, = / ine / 7 (x'M x)” f(x) dx are 
desired. Defining a; = tr(MR)*, we cae. ~ 
Ip = 1, I, =a, Tp = a? + 2aa, 
Iz = a? + 6a,a2 + 8a3, (7.3.19) 
y= at + 12a7a2 + 32a ,a3 + 1202 + 48a4. 





Shown below is Equation (7.3.18) with p = [1 o]" and R-' = f i 
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3. Beta distribution: If the random variable X has the density function 


I'(a+ 8+ 2) 


f(@)= BO +a,1+ Ba - 2)" = Fy 


aad —_ z)P, 
(7.3.20) 
for0 < x < 1, where a > —1 and 6 > —1, then the variable X has a beta 


distribution. 


Properties: 
l+a 
Ment oe eee 13.21) 
iL 1 

Variance = 0? = a 
(2+a+ 8)?(3+a+ 6) 
P(2+ r(1 

r” moment about the origin = v,. = P2ta+srdratr) 

T2Q+a+f8+r\r(1+a) 





4. Chi-square distribution: If the random variable X has the density function 


gp (n—2)/2 ——"/2 
then the variable Xhas a chi-square (7) distribution with n degrees of free- 
dom. This is a special case of the gamma distribution. 


Properties: 
Mean = = n, 
Variance = 0? = 2n, (7.3.23) 
Standard deviation = 0 = V2n. 
(a) If Yi, Yo,..., Y; are independent and identically distributed normal ran- 


n 
dom variables with a mean of 0 and a variance of 1, then x? = b> yy? is 
i=1 
distributed as chi-square with n degrees of freedom. 
(b) If x7, x3, -... x7, are independent random variables and have chi-square 
distributions with n1, n2,..., n~ degrees of freedom, then ee NA has 


a chi-squared distribution with n = Sel n, degrees of freedom. 


5. Exponential distribution: If the random variable X has the density function 


e72/0 
f(a) = 7 for0<x%<o, (7.3.24) 





where 6 > 0, then the variable X has an exponential distribution. 
Properties: 


Mean = yp = 8, 


Variance = 0” = 6”, (7.3.25) 
Standard deviation = o = 0, ~ 


Moment generating function = G(t) = (1 — 6t)~t. 
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6. Gamma distribution: If the random variable X has the density function 


1 


a —/8 
Td +apie® e€ : for0 < 7 < o, (7.3.26) 


f(a) = 


with a > —1 and ( > 0, then the variable X has a gamma distribution. 
Properties: 


Mean = pw = 6(1+4+ a), 
Variance = o? = 67(14+ a), 
Standard deviation = 0 = BV1 +a 
Moment generating function = G(t) = (1— Bt)"'~°, fort < Bt. 


(7.327) 


7. Rayleigh distribution: If the random variable X has the density function 
2 
f(x) = = exp (-=) , forx>0 (7.3.28) 


for o > 0, then the variable X has a Rayleigh distribution. 
Properties: 


Mean = p = o\/7/2 


Variance = 0” (2 _ =) 
(7 — 3)\/m/2 


(7.3.29) 


Skewness = 


8. Snedecor’s F’-distribution: If the random variable X has the density function 


LT (mem) (my™/? .(m—2)/2 
y= ia. eneeee 00, (7.3.30) 


m n m (n+m)/2? 
V(#)0 ($) (1+ 22)" 


then the variable X has a F’-distribution with m and n degrees of freedom. 





Properties: 
n 
Mean = p = ——, forn > 2, 
n—2 
2n2(m +n —2) (7.3.31) 
Variance = —————_~_———_ , forn > 4. 
m(n — 2)?(n — 4) 

(a) The transformation w = mat transforms the F’-density to the beta 


density. . 
(b) If the random variable X has a \?-distribution with m degrees of free- 
dom, the random variable Y has a x?-distribution with n degrees of free- 
X/m 
Y/n 


F-distribution with m and n degrees of freedom. 


dom, and X and Y are independent, then F’ = is distributed as an 
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9. Student’s t-distribution: If the random variable X has the density function 
T (et 
f(z) = —— 
vnal ($) (1+ >) 


then the variable X has a t-distribution with n degrees of freedom. 
Properties: 


for -—co< 4< om. (7.3.32) 


Mean = p = 0, 


7.3.33 
Variance = 0? = ——. forn > 2. ( ) 
n— 


(a) If the random variable X is normally distributed with mean 0 and vari- 
ance o7, and if Y? / o” has a x? distribution with n degrees of freedom, 


xX 
and if X and Y are independent, then t = ” is distributed as a 





t-distribution with n degrees of freedom. 


10. Uniform distribution: If the random variable X has the density function 





1 
f(z) = Boa’ fora <a < £, (7.3.34) 
then the variable X has a uniform distribution. 
Properties: 
a+, 
Mean = p = 
2 
2 
Variance = 0? = (8—a) , 
12 
Ne (7.3.35) 
Standard deviation = 0 = aah 
ebt _ eat 
Moment generating function = G(t) = 
(8—ayjt 
= (a yi sinh |e at) ern 


11. Weibull distribution: If the random variable X has the density function 
f(x) = re a?te-(@/8)* fora > 0 (7.3.36) 


for a > 0 and 8 > 0, then the variable X has a Weibull distribution. 
Properties: 


1 
Mean = = 61 (1+ =) 
a 


2 1 
Variance = a? = 6 Ir (1 + =) =i (1 + *)| 
Q a 


(7.3.37) 
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7.3.3. RELATIONSHIPS AMONG DISTRIBUTIONS 


Dotted lines represent limiting cases of a distribution. (From D. Zwillinger and 
S. Kokoska, Standard Probability and Statistics Tables and Formulae, Chapman & 
Hall/CRC, Boca Raton, Florida, 2000. With permission.) 
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7.3.4 CIRCULAR NORMAL PROBABILITIES 


The joint probability density of two independent and normally distributed random 
variables X and Y (each of mean zero and variance o7) is 


t 1 
f(x,y) = > exp sa (a? + | (7.3.38) 


The probability that a sample value of X and Y is a inside a circle C' of radius 
R at a distance d from the origin is F (4,2) = ff, f(x,y) dx dy. 


R/o=02 04 06 O8 10 15 20 #25 30 


0.077. 0.164 0.273 0.392 : 0.863 0.955 0.989 


0.074 0.158 0.264 0.380 5 0.852 0.950 0.987 
0.068 0.147 0.246 0.357 : 0.831 0.938 0.982 
0.061 0.132 0.222 0.326 : 0.799 0.920 0.975 


0.052 0.114 0.194 0.288 : 0.756 0.895 0.964 
0.016 0.037 0.069 0.111 : 0.469 0.676 0.837 
0.0018 0.0045 0.0094 0.017 A 0.154 0.311 0.510 
0.0001 0.0002 0.0005 0.0011 0. 0.024 0.072 0.171 

0.0008 0.0041 0.017 





7.3.5 CIRCULAR ERROR PROBABILITIES 


The joint probability density of two independent and normally distributed random 
variables X and Y, each of mean zero and having variances a and oe is 


1 1f/2\? y \? 
f(x,y) = See =o (=) + (+) (7.3.39) 
aly x y 


The probability that a sample value of X and Y lie ret a circle with center at 
the origin and radius Ko, is given by P(K, ox, oy) = JJ, f(x,y) dx dy where R is 
the region \/x? + y? < Koz. The following table gives the value of P for various 
values of K and c = o,,/ oy, (for convenience we assume that 0, < oz). 


c=00 02 O04 06 08 
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7.4 QUEUING THEORY 


A queue is represented as A/B/c/K/m/Z where (see Figure 7.2): 


1. A and B represent the interarrival times and service times: 


GI general independent interarrival time, 

G _ general service time distribution, 

Hy, k-stage hyperexponential interarrival or service time distribution, 
FE, Erlang-k interarrival or service time distribution, 

M ~ exponential interarrival or service time distribution, 

D deterministic (constant) interarrival or service time distribution. 


2. cis the number of identical servers. 
3. K is the system capacity. 

4. mis the number in the source. 

5. Z is the queue discipline: 


FCFS first come, first served (also known as FIFO: “first in, first out’), 
LIFO last in, first out, 

RSS random, 

PRI priority service. 


When not all variables are present, the trailing ones have the default values, K = 00, 
m = oo, and Z is FIFO. Note that the m and Z are rarely used. 


FIGURE 7.2 


Conceptual layout of a queue. 





Atrivals Queue Servers Departures 
— 
— 
o—+e— +e-—>.--_>e > — 
m 
K 


7.4. QUEUING THEORY 563 


7.4.1. VARIABLES 


1. Proportions 


(a) G,: proportion of customers that find n customers already in the system 
when they arrive. 

(b) d,: proportion of customers leaving behind n customers in the system. 

(c) Pn: proportion of time the system contains n customers. 


2. Intrinsic queue parameters 


(a) A: average arrival rate of customers to the system (number per unit time) 
(b) ju: average service rate per server (number per unit time), 44 = 1/E[T;]. 
(c) u: traffic intensity, u = A/p. 

(d) p: server utilization, the probability that any particular server is busy, 


p=u/e= (A/p)/c. 


3. Derived queue parameters 


(a) L: average number of customers in the system. 
(b) Lg: average number of customers in the queue. 
(c) N: number in system. 

(d) W: average time for customer in system. 

(e) Wa: average time for customer in the queue. 
(f) 7: service time. 


4. Probability functions 


(a) f(a): probability density function of customer’s service time. 

(b) fw (x): probability density function of customer’s time in system. 
(c) (z): probability generating function of pp: Tm = >>>--9 Pnz”. 
(d) tQ(z): probability generating function of the number in the queue. 
(e) a(s): Laplace transform of f,(2): a(s) = tn fu(aje—** da. 

(f) a7(s): Laplace transform of the service time. 


7.4.2. THEOREMS 


1. Little’s law: L = AW and Lg = AWag. 

2. If the arrivals have a Poisson distribution: pn = Gn. 

3. If customers arrive one at a time and are served one at atime: an = dp. 
4. For an M/M/1 queue with p < 1, 


(a) Pra = (1 = p)p”, 

(b) L=p/(1—p), 

(c) Le = p?/(1— p), 

(d) W =1/(u—A), 

(e) Wa = p/(u— A), 

(f) m(z) = (1— p)/(1 — zp), 

(g) a(s) = (A-p)/(A-p- 8). 
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5. For an M/M/c queue with p < 1 (so that pw, = nu forn = 1,2,...,c and 
Mn = cu forn > c), 


c c~l =a 
u u 
(a) po = ia = ee 
te pou™/n! forn = 0,1,...,¢, 
pou™/cle"—-© forn > c, 
(c) Lg = poup/cl(1 — p)?, 
(d) Wo = Lo/ 
(e) W=Wog+1/p, 
(f) D= AW. 
6. Pollaczek-Khintchine formula: For an M/G/1 queue with p < 1 and 
E[T?|-<c 
(a) L=Lo+p, 
O20 =p)’ 
(c) W =AL, 
(d) Wo =ALo, 


(e) t(z) = TQ(z)ar(A — Az), 
(f) 7Q(z) = (1 — p)(1 — 2)/(a(A — Az) — 2). 


7. For an M/G/oo queue 


(a) py = e tu" /nl, 
(b) (2) = exp (-(1 — 2)u). 

-1 
uc ce uk 
8. Erlang B formula: For an M/G/c/c queue, pe = (>: 7 : 
c! ! 
k=0 


9. Distributional form of Little’s law: For any single server system for which: (i) 
Arrivals are Poisson at rate A, (ii) all arriving customers enter the system and 
remain in the system until served (i.e., there is no balking or reneging), (iii) the 
customers leave the system one at a time in order of arrival, (iv) for any time 
t, the arrival process after time ¢ and the time in the system for any customer 
arriving before ¢ are independent, then 

(a) m(z) = a(A(1 — z)), 
(b) E[L"] = 0p_, S(n, KE [(AW)*] 
where S(n, k:) is Stirling number of the second kind. For example: 
i. E[Z] = AE[W] (Little’s law), 
ii, E[L?] =E[(AW)?] + EDAW]. 
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7.5 MARKOV CHAINS 


A discrete parameter stochastic process is a collection of random variables {X (t), 
t = 0,1,2,...}. (The values of t usually represent points in time.) The values of 
X(t) are the states of the process. The collection of states is the state space. (The 
number of states is either finite or countably infinite.) A discrete parameter stochastic 
process is called a Markov chain if, for any set of n time points tf) < tg <--: < tn, 
the conditional distribution of X (t,,) given values for X (t1), X(t2),..., X(tn—1) 
depends only on X (t,_1). This can be written 


P [X (tn) < In | X (ti) =TZ1,-.. ,X (tn—1) = Ln—-1| 
=P([X(tn) <2n | X(n-1) = 2n-1]. (7.5.1) 
A Markov chain is said to be stationary if the value of the conditional probability 


P(X (tn41) = &n41|X (tn) = Ly] is independent of n. The presentation here is re- 
stricted to stationary Markov chains. 


7.5.1 TRANSITION FUNCTION AND MATRIX 


7.5.1.1. Transition function 


Let «x and y be states and let {t,,} be time points in T = {0,1,2,...}. The transition 
function, P(x, y), is defined by 


P(x, y) = Pan+i(z,y) = P[X(tn41) = y | X (tn) = 2], tnytnoi € T. 
(7.5.2) 
P(a, y) is the probability that a Markov chain in state x at time ¢,, will be in state y 
at time t,,41. Note that P(x, y) > 0 and 57, P(x, y) = 1. The values of P(x, y) are 
commonly called the one-step transition probabilities. 

The function 7o(x) = P(X(0) = x), with mo(x) > 0 and 5°, mo(x) = 1 is 
called the initial distribution of the Markov chain. It is the probability distribution 
when the chain is started. Thus, 

P[X(0) = %0,X(1) =41,...,X(n) = 2p] 


= To(X0)Po,1 (Xo, £1) Pi2(r1, x2) ses Pr—10n (015 a) (7.5.3) 


7.5.1.2 Transition matrix 


A convenient way to summarize the transition function of a Markov chain is by using 
the one-step transition matrix. It is defined as 


P(0,0) P(0,1) ... P(0,n) 
P(1,0) P(1,1) ... P(1,n) 


P= : eo : : (7.5.4) 
P(n,0) P(n,l) ... P(n,n) 
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Define the n—step transition matrix by P as the matrix with entries 
PCy) — P(X Ga) = 7 | Xa) =e), (7.5.5) 


This can be written in terms of the one-step transition matrix as Pp”) = pr, 
Suppose the state space is finite. The one-step transition matrix is said to be 
regular if, for some positive power m, all of the elements of P” are strictly positive. 


THEOREM 7.5.1 = (Chapman—Kolmogorov equation) 

Let P(x,y) be the one-step transition function of a Markov chain and define 
PO) (x,y) = 1, if x = y, and 0, otherwise. Then, for any pair of non-negative inte- 
gers, sandt, such thats +t=n, 


PO (a, y= ye PS) (a, z)P(z,y). (7.5.6) 


7.5.2 RECURRENCE 


Define the probability that a Markov chain starting in state x returns to state x for 
the first time after n steps by 


f"(a,2) = P[X(tn) = 2,X(tn-1) #4,...,X(t1) Aa | X(to) =a]. (7.5.7) 


It follows that P"(x, x) = oy _, f*(x,x)P”"—*(a, x). A state x is said to be recur- 
rent if )°~~_, f"(x,x) = 1. This means that a state x is recurrent if, after starting 
in x, the probability of returning to it after some finite length of time is one. A state 
which is not recurrent is said to be transient. 


THEOREM 7.5.2 


A state x of a Markov chain is recurrent if and only if \>°_, P" (x, 2) = x. 


Two states, x and y, are said to communicate if, for some n > 0, P™ (x,y) > 
0. This theorem implies that, if x is a recurrent state and x communicates with y, 
y is also a recurrent state. A Markov chain is said to be irreducible if every state 
communicates with every other state and with itself. 

Let x be arecurrent state and define T,, the (return time) as the number of stages 
for a Markov chain to return to state x, having begun there. A recurrent state x is 
said to be null recurrent if E[T,] = oo. A recurrent state that is not null recurrent is 
said to be positive recurrent. 


7.5.3 STATIONARY DISTRIBUTIONS 


Let {X(t),¢ = 0,1,2,...} be a Markov chain having a one-step transition function 
P(«,y). A function 7(z) where each m(x) is non-negative, }>, 1(x)P(x,y) = 
m(y), and >7,, 7(y) = 1, is called a stationary distribution. If a Markov chain has a 
stationary distribution and lim,_,., P"(x, y) = 7(y) for every «, then, regardless of 
the initial distribution, 7 (2:), the distribution of X (t,,) approaches 7(x) as n tends to 
infinity. When this happens, 7() is often referred to as the steady state distribution. 
The following categorizes those Markov chains with stationary distributions. 
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THEOREM 7.5.3 


Let X p denote the set of positive recurrent states of a Markov chain. 


I. If Xp is empty, the chain has no stationary distribution. 
2. If Xp is a non-empty irreducible set, the chain has a unique stationary 
distribution. 
3. If Xp is non-empty but not irreducible, the chain has an infinite number of 
distinct stationary distributions. 
The period of a state x is denoted by d(x) and is defined as the greatest common 
divisor of all integers, n > 1, for which P"(x,x) > 0. If P"(x,x) = 0 for all 
n > 1, then define d(x) = 0. If each state of a Markov chain has d(a) = 1, the chain 
is said to be aperiodic. If each state has period d > 1, the chain is said to be periodic 
with period d. The vast majority of Markov chains encountered in practice are ape- 
riodic. An irreducible, positive recurrent, aperiodic Markov chain always possesses 
a steady-state distribution. An important special case occurs when the state space is 
finite. Suppose that X = {1,2,..., A}. Let mo = {70(1), 70(2),..., mo(K)}. 


THEOREM 7.5.4 


Let P be a regular one-step transition matrix and To be an arbitrary vector of initial 
probabilities. Then lity. To(x)P” = y, where yP = y, and year tTo(yi) = 1. 


7.5.3.1. Example: A simple three-state Markov chain 


A Markov chain having three states {0, 1,2} is shown 
3/4 


1/4 3/4 


2» CO) 


This Markov chain has the one-step and two-step transition matrices: 


1/2 


1/2 0 1/2 1/4 3/8 3/8 
P={|1/4 3/4 0 P) — p? = |5/16 9/16 1/8 
0 3/4 1/4 3/16 3/4 1/16 


The one-step transition matrix is regular. This Markov chain is irreducible, and all 
three states are recurrent. In addition, all three states are positive recurrent. Since all 
states have period 1, the chain is aperiodic. The unique steady state distribution is 
(0) = 3/11, r(1) = 6/11, and 7(2) = 2/11. 


7.5.4 RANDOM WALKS 


Let (ti), (t2),... be independent random variables having a common density 
f(a), and let ti, t2,... be integers. Let Xo be an integer—valued random variable 
that is independent of 7(t1), n(tz), ..., and X(tn) = Xo + S7i_, n(ti). The se- 
quence { X(t;),i = 0,1,...} is called a random walk. An important special case is 
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a simple random walk. It is defined by 


p, iwfy=a-1, 
P(x,y)=Sr, ify=a, where p+q+r=1,and P(0,0)=p+r. 
q, ify=at+l, 
(7.5.8) 
Here, an object begins at a certain point in a lattice and at each step either stays at 
that point or moves to a neighboring lattice point. 
This one-dimensional random walk can be extended to higher-dimensional lat- 
tices. A common case is that an object can only transition to an adjacent lattice point, 
and all such transitions are equally likely. In this case 


1. In a one- or two-dimensional lattice, a random walk will return to its starting 
point with probability 1. 

2. In a three-dimensional lattice, the probability that a random walk will return 
to its starting point is P = 0.3405. 

3. Ina d-dimensional lattice (with d > 3), the probability that a random walk will 


d 
1 ce t 
return to its starting point is P = 1 — — with ug = | e! E (5)| dt. 
Ud 0 d 





7.6 RANDOM NUMBER GENERATION 
7.6.1 METHODS OF PSEUDORANDOM NUMBER GENERATION 


In Monte Carlo applications, and other computational situations where randomness 
is required, random numbers must be used. While numbers measured from a phys- 
ical process known to be random have been used, it is much more practical to use 
recursions that produce numbers that behave as random in applications and with re- 
spect to statistical tests of randomness. These are called pseudorandom numbers 
and are produced by a pseudorandom number generator (PRNG). Depending on the 
application, either integers in some range or floating point numbers in [0, 1) are the 
output from a PRNG. Since most PRNGs use integer recursions, a conversion into 
integers in a desired range or into a floating point number in {0, 1) is required. If 7, 
is an integer produced by some PRNG in the range 0 < z,, < M — 1, then an integer 
in the range 0 < x, < N — 1, with N < M, is given by y, = |¥an|. If NK M, 
then y,, = %, (mod N) may be used. Alternately, if a floating point value in [0, 1) 
is desired, let y,, = 2,/M. 


7.6.1.1. Linear congruential generators 


Perhaps the oldest generator still in use is the linear congruential generator (LCG). 
The underlying integer recursion for LCGs is 


Ln =AX%p,-1 +b (mod M). (7.6.1) 


Equation (7.6.1) defines a periodic sequence of integers modulo M starting with xo, 
the initial seed. The constants of the recursion are referred to as the modulus M, 
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multiplier a, and additive constant b. If M = 2", a very efficient implementation is 
possible. Alternately, there are theoretical reasons why choosing M prime is optimal. 
Hence, the only moduli that are used in practical implementations are M = 2" or 
the prime J = 2? — 1 (i.e., M is a Mersenne prime). With a Mersenne prime or any 
modulus “close to” 2”, modular multiplication can be implemented at about twice 
the computational cost of multiplication modulo 2?. 

Equation (7.6.1) yields a sequence {,,} whose period, denoted Per(z,,), de- 
pends on M, a, and b. The values of the maximal period for the three most common 
cases used and the conditions required to obtain them are 


barton) 


Primitive root of MZ | Anything | Prime | M—1 
3 or 5 (mod 8) 2 202 
1 (mod 4) 2 2 


A major shortcoming of LCGs modulo a power-of-two compared with prime 
modulus LCGs derives from the following theorem for LCGs: 





THEOREM 7.6.1 
Define the following LCG sequence: &, = aX%,-, + b (mod M1). If M2 divides 
My, then yn = Ly (mod Mp2) satisfies Yn, = ayn—1 + b (mod Mg). 


Theorem 7.6.1 implies that the /: least-significant bits of any power-of-two modulus 
LCG with Per(z,,) = 2” = M has Per(yn) = 2*, 0 < k < m. Since a long period 
is crucial in PRNGs, when these types of LCGs are employed in a manner that makes 
use of only a few least-significant-bits, their quality may be compromised. When 
is prime, no such problem arises. 

Since LCGs are in such common usage, below is a list of parameter values in 
the literature. The Park—Miller LCG is widely considered a minimally acceptable 
PRNG. Using any values other than those in the following table may result in a 


ker” LCG. 
= [ea] Source] 


7 0 2°! — 1 | Park—Miller 


131 0 235 Neave 
16333 | 25887 gis Oakenfull 





7.6.1.2 Shift-register generators 


Another popular method of generating pseudorandom numbers is using binary shift- 
register sequences to produce pseudorandom bits. A binary shift-register sequence 
(SRS) is defined by a binary recursion of the type, 


In = Tn—-j, DB Ln—jo O-++ B@Ln_j, 5 jt < Jo ee < Ik = £, (7.6.2) 


where @ is the exclusive “or” operation. Note thatz ®y = x+y (mod 2). Thus the 
new bit, x, is produced by adding k previously computed bits together modulo 2. 
The implementation of this recurrence requires keeping the last ¢ bits from the se- 
quence in a shift register, hence the name. The longest possible period is equal to the 
number of non-zero ¢-dimensional binary vectors, namely 2 — 1. 
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A sufficient condition for achieving Per(x,,) = 2 — 1 is that the characteristic 
polynomial, corresponding to Equation (7.6.2), be primitive modulo 2. Since prim- 
itive trinomials of nearly all degrees of interest have been found, SRSs are usually 
implemented using two-term recursions of the form, 


Ln = In_k OB Un_2, O<k<f. (7.6.3) 


In these two-term recursions, k is the Jag and £ is the register length. Proper choice 
of the pair (¢, k) leads to SRSs with Per(x,,) = 2° — 1. Here is a list with suitable 


(2, k) pairs: 
Primitive trinomial exponents 





7.6.1.3 Lagged-Fibonacci generators 


Another way of producing pseudorandom numbers uses lagged-Fibonacci genera- 
tors. The term “lagged-Fibonacci” refers to two-term recurrences of the form, 


En = Un—-kO Ln-e, 0<k< £, (7.6.4) 


where © refers to one of the three common methods of combination: (1) addition 
modulo 2”, (2) multiplication modulo 2””, or (3) bitwise exclusive ‘OR’ing of m- 
long bit vectors. Combination method (3) can be thought of as a special implemen- 
tation of a two-term shift-register sequence. 

Using combination method (1) leads to additive lagged-Fibonacci sequences 
(ALFSs). If x, is given by 


Ln =ILn-k+Xn—e (mod 2”), 0<k<Z, (7.6.5) 


then the maximal period is Per(a,) = (26 — 1)2™—1. 

ALFSs are especially suitable for producing floating point deviates using the 
real-valued recursion y, = Yn—k + Yn—e (mod 1). This circumvents the need to 
convert from integers to floating point values and allows floating point hardware to 
be used. One caution with ALFSs is that Theorem 7.6.1 holds, and so the low-order 
bits have periods that are shorter than the maximal period. However, this is not nearly 
the problem as in the LCG case. With ALFSs, the 7 least-significant bits will have 
period (2° — 1)2/—1, so, if @ is large, there really is no problem. Note that one can 
use the table of primitive trinomial exponents to find (¢, &) pairs that give maximal 
period ALFSs. 


7.6.1.4 Non-linear generators 


Also possible for PRNGs are non-linear integer recurrences. For example, if in equa- 
tion (7.6.4) “o” referred to multiplication modulo 2””, then this recurrence would be 
a multiplicative lagged-Fibonacci generator (MLFG); a non-linear generator. The 
mathematical structure of non-linear generators is qualitatively different than that of 
linear generators. Thus, their defects and deficiencies are thought to be complemen- 
tary to their linear counterparts. 
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The maximal period of a MLFG is Per(a,,) = (2—1)2”~%, a factor of 4 shorter 
than the corresponding ALFS. However, there are benefits to using multiplication as 
the combining function due to the bit mixing achieved. Because of this, the perceived 
quality of the MLFG is considered superior to an ALFS with the same lag, @. 

We now illustrate two non-linear generators, the inversive congruential genera- 
tors (ICGs), which were designed as non-linear analogs of the LCG. 


1. The implicit ICG is defined by the following recurrence that is almost that of 
an LCG (assume that / is a prime) 


Ln =AF,-1+b (mod M). (7.6.6) 


The difference is that we must also take the multiplicative inverse of x,_1, 
which is defined by 7-1 %n_1 = 1 (mod M), and 0 = 0. This recurrence 
is indeed non-linear, and avoids some of the problems inherent in linear recur- 
rences, such as the fact that linear tuples must lie on hyperplanes. 


2. The explicit ICG is 
Ln =an+b (mod M). (7.6.7) 


One drawback of ICGs is the cost of inversion, which is O(log, M) times the cost 
of multiplication modulo /. 


7.6.2 GENERATING NON-UNIFORM RANDOM VARIABLES 


Suppose we want deviates from a distribution with probability density function f(z) 
and distribution function F(x) = f”.. f(w) du. In the following “y is U[0,1)” 
means y is uniformly distributed on [0, 1). 

Two general techniques for converting uniform random variables into those from 
other distributions are as follows: 


1. The inverse transform method: 
If y is U[O, 1), then the random variable F~'(y) will have its density equal to 
f(x). (Note that F~'(y) exists since 0 < F(x) < 1.) 

2. The acceptance-rejection method: 
Suppose the density can be written as f(%) = Ch(x)g(a) where h(x) 
is the density of a computable random variable, the function g satisfies 
0 < g(x) <1, and C7! = [™ h(u)g(u) du is a normalization constant. If 
x is U[0,1), y has density h(x), and if « < g(y), then x has density f(z). 
Thus one generates {x, y} pairs, rejecting both if « > g(y) and returning « if 


z< g(y). 
EXAMPLES 


1. Examples of the inverse transform method: 

(a) Exponential distribution: The exponential distribution with rate A has f(a) = 
Ae~** (for a > 0) and F(x) = 1 — e~*”. Thus u = F(x) can be solved to 
give a = F~'(u) = —A7'In(1 — wu). If wis U[O, 1), then so is 1 — u. Hence 
x = —\~' Inwis exponentially distributed with rate 2. 
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(b) Normal distribution: Suppose the z;’s are normally distributed with density func- 
tion f(z) = see! 2. The polar transformation then gives random variables 
r = \/z? + 23 (exponentially distributed with \ = 2) and @ = tan! (z2/z1) 
(uniformly distributed on [—, 2). Inverting these relationships results in 


z= V—2In2)cos27x2 and z2 = ~—2In2x) sin 27x2; each is normally 
distributed when x1 and x2 are U 9, 1). (This is the Box—Muller technique.) 


2. Examples of the rejection method: 
(a) Exponential distribution with X = 1: 
i. Generate random numbers {U;}j~, uniformly in [0, 1]), stopping at 
N =min{n | Ui >-+- > Un-1 < Un}. 
ii. If N is even, accept that run, and go to step iii. If N is odd reject the run, 
and return to step i. 


iii. Set X equal to the number of failed runs plus U1 (the first random number 
in the successful run). 


(b) Normal distribution - using uniform random variables: 


i. Select two random variables (V,, V2) from U[0, 1). Form R = V? + V2. 
ii. If R > 1, then reject the (Vi, V2) pair, and select another pair. 


ii. IfR <1, thenxz = Vj\/ 248 has a N(0, 1) distribution. 


(c) Normal distribution - using exponential random variables: 
i. Select two exponentially distributed random variables with rate 1: (VY, V2). 
ii, If Vo > (Vi — 1)?/2, then reject the (Vi, V2) pair, and select another pair. 
iii. Otherwise, Vi has a N(0, 1) distribution. 


(d) Cauchy distribution: 


To generate values of X from f(x) = =U on —oo < & < ov, 


i. Generate random numbers Uj, U2 (uniform on [0, 1)), and set 
=U, — 4, Y2 =U2—- 35. 
ii. HYP +YZ < i, then return X = Yi /Y2. Otherwise return to step (a). 





To generate values of X from a Cauchy distribution with parameters 6 and 0, 


t 
x2) = ————— for — & < x < & }, construct X as above, and 
(1@) = ee 

then use BX + 0. 


7.6.2.1. Discrete random variables 


The density function of a discrete random variable that attains finitely many values 
can be represented as a vector p = (po, P1,---;Pn—1, Pn) by defining the probabili- 
ties P(x = j) = p; (for j = 0,...,n). The distribution function can be defined by 
the vector ¢ = (co, ¢1,---,Cn—1, 1), where c; = )7/_) p;. Given this representation 
of F(x), we can apply the inverse transform by computing x to be U[0, 1), and then 


finding the index 7 so that c; < x < cj41. In this case event 7 will have occurred. 
Examples: 
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1. (Binomial distribution) The binomial distribution with n trials of mean p has 
Pj = (Spi — p)"~4, for j =0,...,n. 


(a) As an example, consider the result of flipping a fair coin. In 2 flips, the 
probability of obtaining (0, 1,2) heads is p = (4,4,4). Hence c = 
(4, 4,1). If x (chosen from U[0,1)) turns out to be say, 0.4, then “1 
head” is returned (since + <0.4< 3), 

(b) Note that, when n is large, it is costly to compute the density and distri- 
bution vectors. When 7 is large and relatively few binomially distributed 
pseudorandom numbers are desired, an alternative is to use the normal 
approximation to the binomial. 

(c) Alternately, one can form the sum 57", |u; +p|, where each u; is 


U0, 1). 


2. (Geometric distribution) To simulate a value from P(X = i) = p(1 — p)'"! 
log U 
log(1 — p) | 


3. (Poisson distribution) The Poisson distribution with mean A has pj; = 
e-/j! for 7 > 0. The Poisson distribution counts the number of events 
in a unit time interval if the times are exponentially distributed with rate . 
Thus, if the times ¢; are exponentially distributed with rate \, then 7 will 
be Poisson distributed with mean \ when )~/_,t; < 1 < ear t;. Since 
t; = —A7!Inu,;, where u; is U [0, 1), the previous equation may be written 


fori > 1yuse X= 1+] 


as [es wu, > eA > i eae u;. This allows us to compute Poisson random 
variables by iteratively computing P; = [6 u,; until P; < e—>. The first 
such 7 that makes this inequality true will have the desired distribution. 


Random variables can be simulated using the following table (each U and U; is 
uniform on the interval [0, 1)): 


Distribution Formula for deviate 


Pj ) p(l—p)"? oe [Ui +P] 


i=1 


f(a) = ab*/x**4 b/ur/e 
Rayleigh | f(e)=a/oe"?" | ov=no | 


—InU 
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7.7 RANDOM MATRICES 


A random matrix is a matrix whose entries are from a specific distribution. 
Let M,, be an n X n matrix where each (mij) independently comes from a 
standard normal distribution (i.e., every element has mean zero and variance one). 


1. The expected number of real eigenvalues (£,,) of the matrix M,, is: 


n/2-1 
4k —1)!! 
v2 » ea when n is even 
k=0 i 
En = (n—1)/2 (4k — 3)! 
1+Vv2 > Gk—D! when n is odd (7.7.1) 
k=0 
2n 
oe | a asn—-> co 
1 


2. The expected number of complex eigenvalues (c,,) of the matrix 7, is c, = 
n— Ey, with cy = 0, co =2— V2, c3 =2— $2, and cy =4- PYV2. 

3. Let p,, be the probability that M,, has exactly k real eigenvalues. Then 
Prin = 2—-(n—1)/4_ Formulae are also available for the other values of {Pn,n}- 

4. Let p,(x,y) be the probability density that M/,, has « + iy as eigenvalues. 
Then 





2 »2 T'(n — 1,2? + y?) 
pn(a,y) = 4f—e yerfe (v2y Prod (7.7.2) 
5. Consider the eigenvalues {A} of M,. Girko’s circular law states that > is 


uniformly distributed in the unit circle as n — oo. Below are images of - for 
samples with n equal to 20, 50, and 100. 



































Wigner’s Semicircle law: Let R,, be an n-by-n real symmetric matrix with random 
elements {rij | i < 7 < n}. Assume the random elements of R,, are identically 
distributed, have second moment equal to m2, and all the moments are bounded 
independent of n. Let Sy, a(n) be the number of eigenvalues of f,, that are in the 
real interval (a\/n, 6\/n), with a < £. Then the expected value of S.,(n) satisfies 


B 
lim E [Sa,a(n)] = =| V4m2 — x? dx (7.7.3) 
mm? J 


n—0o n 
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7.8 CONTROL CHARTS AND RELIABILITY 


7.8.1 CONTROL CHARTS 


Control charts are graphical tools used to assess and maintain the stability of a pro- 
cess. They are used to separate random variation from specific causes. Data mea- 
surements are plotted versus time along with upper and lower control limits (UCL 
and LCL) and a center line. If the process is in control and the underlying distribu- 
tion is normal, then the control limits represent three standard deviations from the 
center line (mean). 

If all of the data points are contained within the control limits, the process is con- 
sidered stable and the mean and standard deviations can be reliably calculated. The 
variations between data points occur from random causes. Data outside the control 
limits or forming abnormal patterns point to unstable, out-of-control processes. 

There are two types of control charts: 


e Control charts for attributes: the data are from a count. If every item is either 
“good” or “bad,” then “defectives” are counted. If each item may have several 
flaws, then “defects” are counted. 


p chart (defectives, sample size varies, uses Binomial statistics) 
np chart (defectives, sample size fixed, uses Binomial statistics) 
u chart (defects, sample size varies, uses Poisson statistics) 
c chart (defects, sample size varies, uses Poisson statistics) 


e Control charts for variables: the data are from measurements on a variable or 
continuous scale. Statistics of the measurements are used, Gaussian statistics 
used. 


— Z— R chart (sample average versus sample range) 

— «— Rchart (sample median versus sample range) 

— &— s chart (sample average versus sample standard deviation) 

x — Rs chart (samples versus moving range, Rs = |x; — x;~1|). Similar 
to a x — FR chart but single measurements are made. Used when measure- 
ments are expensive or dispersion of measured values is small. 


In the tables, & denotes the number of samples taken, 7 is an index for the samples 
(i = 1...k), n is the sample size (number of elements in each sample), and R is 
the range of the values in a sample (minimum element value subtracted from the 
maximum element value). The mean is yu and the standard deviation is oc. 
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Types of control charts and limits (‘“‘P” stands for parameters) 





Z— 2.66Rs 

















Pre [ 03.686 [— [3.267 [1.000 | 1.880 | 
1.693 [0__[a358[— [2575 | 1.160] 1.187 _| 


6 [0a [2534 [0 [5.078 [= [2.004 [1.135 | 0549_| 
[8 _[ 0373 [2847 [0387 [5.307 [0.136 | 1.864 [1.160 | 0.432 | 
[9 __ [0337 [2.970 [0546 [5.394 [0.184 | 1816 | 1.223 [oaT2 | 
[i __[oaas [3.173 [oso [ss34fo2se[ iat |_| 
[2 [0.266 [3.258 [0924 [359 [oe [T7I6; |__| 
[8 [ 0249-3336 | 1.026 [5.646 [0308 | .OZP |__| 
[_4__ [0235 [3407 [1121 [93 [039 [Ton | |__| 
[_1s_ [023 [3.472 [1207 [5737 [ose | 1os2] | _—_+| 
[16 [0212 [3532 [1285 [5.779 [0364 [ 1636, |_| 
[17 [ 0.308 [3588 [1359 [S817 [0379 | Tear| |__| 
[18 __[ 0194 | 3.640 [1426 [5.854 [0392 | To0e| |_| 
[19 [0187 [3.089 [1490 [ sna [0404 [ 1596, |__| 
[20 __ [0180 [3.735 [1548 [5922 Joss [1586, |__| 


P25 [ors [3931 [1.806 [6056 oay [Ts] |_| 
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Abnormal distributions of points in control charts 


Description 
Sequence Seven or more consecutive points on one side of the 
PONS ___[Eeverine Denese serge vale assed 
Bias Fewer than seven consecutive points on one side of the 

center line, but most of the points are on that side. 


10 of 11 consecutive points 
12 or more of 14 consecutive points 


14 or more of 17 consecutive points 
16 or more of 20 consecutive points 


Trend Seven or more consecutive rising or falling points. 


Approaching the limit | Two out of three or three or more out of seven 
consecutive points are more than two-thirds the 
distance from the center line to a control limit. 


Periodicity The data points vary in a regular periodic pattern. 


7.8.2 SIGMA CONVERSION TABLE 


Defects per million Sigma level Cox (Sigma level/3) 
opportunities (with 1.5 sigma shift) with 1.5 sigma shift 


933,200 0.000 0.000 
500,000 1.500 0.500 





6,210 4.000 1.333 
233 5.000 1.667 
3.4 


6.000 2.000 


66,800 3.000 1.000 





7.8.3 RELIABILITY 


1. The reliability of a product is the probability that the product will function 
within specified limits for at least a specified period of time. 

2. A series system is one in which the entire system will fail if any of its compo- 
nents fail. 

3. A parallel system is one in which the entire system will fail only if all of its 
components fail. 

4. Let R; denote the reliability of the 7” component. 

5. Let R, denote the reliability of a series system. 

6. Let R, denote the reliability of a parallel system. 


The product law of reliabilities states Rg = II Rj. 


i=1 
n 


The product law of unreliabilities states R, = 1 — [[a — R). 
i=1 
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7.8.4 FAILURE TIME DISTRIBUTIONS 


1. Let the probability of an item failing between times t and t + At be f(t) At + 
o(At) as At > 0. 
2. The probability that an item will fail in the interval from 0 to ¢ is 


t 
F(t) =} f(a) da. (7.8.1) 
0 
3. The reliability function is the probability that an item survives to time t 
R(t) =1- F(t). (7.8.2) 


4. The instantaneous hazard rate, Z(t), is approximately the probability of fail- 
ure in the interval from ¢ to t + At, given that the item survived to time t 
f(t) f@) 


Z(t) = RO ~ ToFO (7.8.3) 


Note the relationships: 


R(t) = e7 Jo 2@) de f(t) = Z(t)e” fo 2@) de (7.8.4) 


EXAMPLE If f(t) = apte-tert with a > 0 and 8 > 0, the probability distribution 
function for a Weibull random variable, then the failure rate is Z(t) = aft?—* and 


B : ra ee F : 
R(t) =e °" . Note that failure rate decreases with time if 8 < 1 and increases with 
time if 8 > 1. 


7.8.4.1 Use of the exponential distribution 


If the hazard rate is a constant Z(t) = a (with a > 0) then f(t) = ae~™ (fort > 0) 
which is the probability density function for an exponential random variable. If a 
failed item is replaced with another having the same constant hazard rate a, then the 
sequence of occurrence of failures is a Poisson process. The constant 1/a is called 
the mean time between failures (MTBF). The reliability function is R(t) = e~°*. 

If a series system has n components, each with constant hazard rate {a;}, then 


R,(t) = exp (- S- «) ; (7.8.5) 
w=1 


The MTBF for the series system is j5 


1 
le=F (7.8.6) 


I i 
maT gh 
If a parallel system has n components, each with identical constant hazard rate a, 


then the MTBF for the parallel system is 1, 


1 1 1 
pa (1e5 bts), (7.8.7) 
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7.8.5 PROCESS CAPABILITY 


Notation 
e C process capability e LSL lower specification limit 
@ Cx process capability index e T target value 
e Cy process capability (one-sided) e USL upper specification limit 
¢ Cym process capability index © |4 process mean 
e Cy process capability (one-sided) © o process standard deviation 
Definitions 
USL — pw pu — LSL 
GC, wu = ' = 
- 30 Cor 30 
C= USL — LSL = Cou + Cpi 
. 60 2 (7.8.8) 
USL — —LSL #08 
Cok = min (a. —) = min (Cou; Cy1) 
USL — LSL 
Com — 
6 Jor +n —-TP 
Estimates (here {71,7} are estimates of {ju, 0 }) 
a USL — LSL 
a 
i 60 
a . (USL—f fi—LSL 
Cpk = min (a SS (7.8.9) 
a USL — LSL 


"6/2 + (@—T)? 
Approximate 100(1 — a)% confidence interval assuming normal data and n > 25: 
Be 1 C2, 
Cok = Cok + 21-0 —+~___ 
Pe pel ae on. 1) 





Comments 


1. Cp adjusts C,, to account for the effect of a non-centered distribution. 

2. Cpm is used when a target value other than the center of the specification 
spread has been designated as desirable. 

3. Usually ji = Z. When there are subgroups (page 575 has dz and d4 values): 


(a) G = R/dz where R is the average of the ranges; or 
(b) o = §/d4 where § is the average of the sample standard deviations 


4. The process must be in control before the process capability is computed; an 
out-of-control process will not yield a valid & estimate. 


EXAMPLE The specification limits of a process are LSL = 8 and USL = 20. Process 
measurements yield Z = 16 and G = 2. Hence, Cp = 1.0 which means that this 
process is capable. However, Cx = 0.67 which means this process is not good (a 
value of Ca > 1 is desired). 
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7.9 STATISTICS 


Probability and statistics are related, but different concepts; statistics uses probabilis- 
tic thinking and analysis. The probability of an event is the likelihood of that event 
occurring; it is the relative frequency over a very large sample. A statistic is a value 
computed from a finite sample population. 


7.9.1 DESCRIPTIVE STATISTICS 
1. Sample distribution and density functions 


(a) Sample distribution function: 


F(x) =— ~ 2; 7.9.1 
(2) == 2 u(x ~ 2) (7.9.1) 
where u() be the unit step function (or Heaviside function) defined by 
u(a) = 0 fora < Oand u(x) = 1 fora > 0. 
(b) Sample density function or histogram: 
A F(ao + (6+ 1)w) — F(xo + iw 
je) — Pot i+ Dw) ~ Flao + iw) 
w 
for x € [vp +iw, xo + (i+ 1)w). The interval [x9 + iw, vo + (i+ 1)w) 
is called the i bin, w is the bin width, and f; = F(xo + (i + 1)w) — 


(7.9.2) 





F(x + iw) is the bin frequency. 
2. Order statistics and quantiles: 
(a) Order statistics are obtained by arranging the sample values 
{x1,X2,...,%y} in increasing order, denoted by 
i. %(1) and xy) are the minimum and maximum data values 
ii. For? = 1,...,m, x) is called the i” order statistic. 


(b) Quantiles: If 0 < p < 1, then the quantile of order p, &), is defined as 
the p(n + 1)" order statistic. It may be necessary to interpolate between 
successive values. 


i. Ifp = 9/4 for 7 = 1, 2, or 3, then oi is called the j"* quartile. 
it. Ifp = 7/10 for 7 = 1,2,...,9, then ae is called the j" decile. 
iii. If p = 7/100 for 7 = 1,2,...,99, then i is called the j"" per- 
centile. 
3. Measures of central tendency: 


(a) Arithmetic mean: 


B=) gq, =O (7.9.4) 
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(b) a-trimmed mean: 


n—k-1 
= 1 
Le = n(1 — 2a) (a r) (x(441) + 2(n—k)) + SS ne] é 


i=k+2 
(7.9.5) 
where k = |an| is the greatest integer less than or equal to an, and 
r=an—k.lIfa=Othen%, =7. 
(c) Weighted mean: If to each x; is associated a weight w; > O so that 


Su =1, then 7, = dite (7.9.6) 
w=1 t=1 


(d) Geometric mean: (for x; > 0) 


ni 1/n 
GM = (11 «) = (2129++- En)”. (7.9.7) 
i= 


(e) Harmonic mean: 
n n 
anes oma] I ie 
»~ rere 


i=1 x; Ly 


HM = (7.9.8) 





(f) Relationship between arithmetic mean (%), geometric mean (GM), and 
harmonic mean (HM), when x; > 0: 


HM <GM<@z (7.9.9) 


with equality holding only when all sample values are equal. 
(g) The mode is the data value that occurs with the greatest frequency. Note 
that the mode may not be unique. 
(h) Median: 
i. Ifnis odd and n = 2k + 1, then M = 2(%41). 
ii. If n is even and n = 2k, then M = (a (4) + 2(n41))/2. 
(i) Midrange: 
a tee) 


mid = 25. (7.9.10) 


4. Measures of dispersion 


(a) Mean deviation or absolute deviation: 


1S Li 
M.D. = — i-Zl, A.D=— c= Mi: 
So |ai-F, or — > te — MI 


i=l i=1 


(7.9.11) 


(79:12) 
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5. Higher-order statistics 


CHAPTER 7. PROBABILITY AND STATISTICS 


(c) The sample variance is the square of the sample standard deviation. 


(d) Root mean square: R.M.S. = 





(e) Sample range: Xin) — X(1). 

(f) Interquartile range: Es - fu. 

(g) The quartile deviation or semi-interquartile range is one-half the in- 
terquartile range. 


1 ; 
(a) Sample moments: Mr = 7 ak. 
i=1 
(b) Sample central moments, or sample moments about the mean: 
1 n eae 
My = — ) (vi — F) 
n 4 
1=1 


7.9.2 STATISTICAL ESTIMATORS 
7.9.2.1 Definitions 


1. A function of a set of random variables is a statistic. It is a function of ob- 


servable random variables that does not contain any unknown parameters. A 
statistic is itself an observable random variable. 


. Let 6 be a parameter appearing in the density function for the random variable 


X. Suppose that we know a formula for computing an approximate value 0 
of 0 from a given sample {x1,...,2n} (call such a function g). Then 6 = 
g(@1,%2,...,%n) can be considered as a single observation of the random 
variable 0 = g(X1, X2,..., Xn). The random variable O is an estimator for 
the parameter 0. 


. A hypothesis is an assumption about the distribution of a random variable X. 


This may usually be cast into the form 6 € Og. We use Ho to denote the null 
hypothesis and H, to denote an alternative hypothesis. The null hypothesis is 
a statistical hypothesis tested for possible rejection (usually by finding that a 
very unlikely event occurs when the null hypothesis is assumed to be true). 


. In significance testing, a test statistic T = T(X1,..., Xn) is used to reject 


Ao, or to not reject Hy. Generally, if T € C, where C is a critical region, then 
1 is rejected. 


. A type I error, denoted a, is to reject Ho when it should not be rejected. A 


type II error, denoted (3, is to not reject Ho when it should be rejected. 


. The power of a test is 7 = 1 — (. 


D oer ey: True decision. Type IJ error. 
Oo norreyect 70 | Probability is1—a | Probability is B 
: Type I error. True decision. 
Probability is a Probability is 7 = 1 — 6 
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7.9.2.2 Consistent estimators 


Let 6 = g(X1, Xo,..., Xn) be an estimator for the parameter 0, and suppose that g 
is defined for arbitrarily large values of n. If the estimator has the property, 
E[(© — @)?] — 0, as n — oo, then the estimator is called a consistent estimator. 


1. A consistent estimator is not unique. 
2. Aconsistent estimator need not be unbiased. 


7.9.2.3 Efficient estimators 
An unbiased estimator 6 = g(X1, X2,..., Xn) for a parameter 6 is said to be effi- 


cient if it has finite variance (E [6 — @©)?| < oo) and if there does not exist another 


estimator O* = g*(X1, X2,...,Xn) for #, whose variance is smaller than that of 


n 


O. The efficiency of an unbiased estimator is the ratio, 


Cramer—Rao lower bound 
Actual variance : 


The relative efficiency of two unbiased estimators is the ratio of their variances. 


7.9.2.4 Maximum likelihood estimators (MLE) 


Suppose X is a random variable whose density function is f(x; 0), where 6 = (0;, 


.., ,). If the independent sample values x1, ..., x, are obtained, then define the 
likelihood function as L = [J;_, f(xi;@). The MLE estimate for @ is the solution of 
the simultaneous equations, a, = 0, fors = 1,....,7. 

1. A MLE need not be consistent. 

2. A MLE may not be unbiased. 

3. A MLE need not be unique. 

4. If a single sufficient statistic T’ exists for the parameter 0, the MLE of 6 must 


be a function of 7’. 
5. Let 0 be a MLE of 0. If r(-) is a function with a single-valued inverse, then a 


a 


MLE of 7(@) is 7(Q). 


Define & = S0_, Xi/n and S? = >", (X; — F)?/n (note that S # s). Then: 


i=l 


Distribution Estimated MLE estimate 
parameter of parameter 


Exponential E( 
Exponential E( 


Normal N(p1, 0 
Normal N(p1, 0 
Poisson P(X) 
Uniform U (0, 6) 
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7.9.2.5 Method of moments (MOM) 


Let {X;} be independent and identically distributed random variables with eesty 
f(x; 0). Let yp! (0) = E[X"] be the r™ moment (if it ae Lem = 2 ye 
be the r® sample moment. Form the k equations, pv’, = m/., and salve to obtain an 


estimate of 0. 


1. MOM estimators need not be unique. 
2. MOM estimators may not be functions of sufficient or complete statistics. 


7.9.2.6 Sufficient statistics 


A statistic G = g(X1,..., Xp) is called as a sufficient statistic if and only if the 
conditional distribution of H, given G,, does not depend on @ for any statistic H = 
A(Xy,..-,Xn). 

Let {X;} be independent and identically distributed random variables, with den- 
sity f(x; 0). The statistics {G1,...,G,} are said to be jointly sufficient statistics if 
and only if the conditional distribution of X), X2,..., X, given G, = 91, Gi = go, 

., G, = gy does not depend on 6. 
Note that a single sufficient statistic may not exist. 


7.9.2.7 UMVU estimators 


A uniformly minimum variance unbiased estimator, called a UMVU estimator, is 
unbiased and has the minimum variance amine all unbiased estimators. 
Define, as usual, = )>j_, X;/n and s? = >", (X; — Z)?/(n — 1). Then: 


Distribution Estimated | UMVU estimate | Variance of 
ae of parameter estimator 
n—-1 


A A 


Poisson P(X) —_| P(r 


n(n+ n(n +2) 





7.9.2.8 Unbiased estimators 
An estimator g(X1, X2,..., Xn) for a parameter 6 is said to be unbiased if 
Elg(X1, X2,...,Xn)] = 4. (7.9.13) 
1. An unbiased estimator may not exist. 


2. An unbiased estimator is not unique. 
3. An unbiased estimator need not be consistent. 
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7.9.2.9 Estimators for mean and variance 
The estimates below do not use all of the data points; except in the n = 2 case. 


Hence, their efficiencies are all less than 1. 
The variance of the estimates below must be multiplied by the true variance of 


the sample, o?. 


e Small samples 


1. Estimating standard deviation o from the sample range w 


Efficiency 
2 : 


EificTenoy 
2 


0.4539 (a4 _ x1) ial 0.1102 (a3 — x2) 
0.3724 (a5 = x1) ili 0.1352 (a3 = x2) 
i 0.1386 (25 = x2) ae 0.0432 (a4 = x3) 
- 0.1351 (a6 ae x2) a 0.0625 (a5 = x3) 











e Large samples 
Use percentile estimates to estimate the mean and standard deviation. 


1. Estimators for the mean 


P50 
'/y (Pos + Prs) 
1/3 (Pi7 + Pso + Ps) 
Vg (Pia.5 + P37.5 + Poo.5 + Paz7.s) 
1/5 (Pio + P30 + Ps0 + Pro + Poo) 


2. Estimators for the standard deviation 


Number of terms Estimator using percentiles Efficiency 




















2 0.3388 (Pas — Py) 65 
4 01714 (Piet Pig — Pig — BP) 80 
6 ONS Pat Po. = Py Py=P)|. 87 
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7.9.3 CRAMER-RAO BOUND 


The Cramer—Rao bound gives a lower bound on the variance of an unknown un- 
biased statistical parameter, when n samples are taken. When the single unknown 
parameter is 0, 


o*(0) > ee ee ee (7.9.14) 


~ —nE a log f(z; 0)| nE ie log f (x; 6))"| 





EXAMPLES 
1. For anormal random variable with unknown mean @ and known variance o”, the den- 


sity is f(2;0) = —- exp (-*). Hence, Z log f(2;0) = (a — 0)/o?. The 


270 
computation 


p/ | i (x-—0)? 1 _ (#0)? /202 co 
ess o 


ot 210 





results in 7 (0) > z 
2. For anormal random variable with known mean yp and unknown variance 0 = a”, the 
5 2 
density is f(a;0) = Tarn exP (-S#). Hence, & log f(a;0) = ((x — yw)? — 
20) /(20)?. The computation E a = str = str results in 070) > 20*/n. 
3. For a Poisson random variable with unknown mean 0, the density is f(#;0) = 


6” e~° /x!. Hence, a log f(x; 0) = x/@ — 1. The computation 


x 2 Sa 29769 1 . 2 
ey = a —_ == => - 
E (G 1) > ( 1) ‘Al 7 results in 0“ (0) > 0/n 


7.9.4 CLASSIC STATISTICS PROBLEMS 
7.9.4.1 Sample size problem 


Suppose that a Bernoulli random variable (page 621) is to be estimated from a sam- 
ple. What sample size n is required so that, with 99% certainty, the error is no more 
than e = 5 percentage points (i.e., Prob(|p — p| < 0.05) > 0.99)? 

If an a priori estimate of p is available, then the minimum sample size is n, = 
= /2P(1 — p)/ e*. If no a priori estimate is available (i.e., no estimate is available 
before the experiment), then n,. = rd /2 / 4e? > Np |p=1 /2: For the numbers above, 
nN > Nn = 664. Section 7.14 on page 620 has more information on sample sizes. 


7.9.4.2 Large scale testing with infrequent success 


Suppose that a disease occurs in one person out of every 1,000. Suppose that a test 
for this disease has a type I and a type IL error of 1% (that is, a = 6 = 0.01). Imagine 
that 100,000 people are tested. Of the 100 people who have the disease, 99 will be 
diagnosed as having it. Of the 99,900 people who do not have the disease, 999 will 
be diagnosed as having it. Hence, only 22 ~ 9% of the people who test positive 


: : 1098 
for the disease actually have it. 
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7.9.5 ORDER STATISTICS 


When {X;} are nm independent and identically distributed random variables with 
the common distribution function Fx (x), let Zm be the m" largest of the values 
(m = 1,2,...,n). Hence 7, is the maximum of the n values and Z,, is the minimum 
of the n values. Then 


Fz,,(«) = )~ (") [Fx(x)]* (1 — Fx(2)]"~ (7.9.15) 


i=m 


Frax(z) = [Fx (z)]” fnax(z) = 2 [Fx(z)]"* fx (z), (7.9.16) 
Fin(z) =1—[1—Fx(2))", — fnin(z) = 0 [1 — Fx(z)]"™* fx(z)- (7.9.17) 


The expected value of the i" order statistic is given by 


Blea] = CED [ . xf(x)F'\(e)[1— F(@)|""'de. (7.9.18) 


7.9.5.1 Uniform distribution 
If X is uniformly distributed on the interval [0, 1) then 


n! 


E [zy] = rte h a'(1— a)" de. (7.9.19) 











at: . 


of n samples is = 7" 


7.9.5.2 Normal distribution 
The following table gives values of E [za] for a standard normal distribution. Miss- 
ing values (indicated by a dash) may be obtained from E [zy] =-—-E [t~m—-41)| : 


pi | nm =2 | 


0. = a 


0.0000 0.2016 0.3527 














EXAMPLE 
If a person of average intelligence takes five intelligence tests (each test having a normal 
distribution with a mean of 100 and a standard deviation of 20), then the expected value 
of the largest score is 100 + (1.1630)(20) = 123. 
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7.10 CONFIDENCE INTERVALS 


A probability distribution may have one or more unknown parameters. A confidence 
interval is an assertion that an unknown parameter lies in a computed range, with a 
specified probability. Before constructing a confidence interval, first select a confi- 
dence coefficient, denoted 1 — a. Typically, 1 — a = 0.95,0.99, or the like. The 
definitions of zq, ta, and x2, are in Section 7.17.1 on page 628. 


7.10.1. SAMPLE FROM ONE POPULATION 


The following confidence intervals assume a random sample of size n, given by 
{21,%2,..-,;2n}. 


100(1 — a)% confidence 
assumptions 
parameter p interval 
normal distribution, 7 
normal distribution, 7 





co Bernoulli trials Pt Zas2 aes 


normal distribution ieee 1)s Ls 1)s? 
Nee a a/2 
| sin 


1. Find mean of the normal distribution with known variance o? 





(a) Determine the critical value z,/2 such that ® (2 /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 

(b) Compute the mean 7 of the sample. 

(c) Compute k = zy/20/\/no. 

(d) The 100(1 — a) percent confidence interval for y is given by 
[cr —k,z+ky. 


2. Find mean yp of the normal distribution with unknown variance o?. 


(a) Determine the critical value t,/2 such that F’ Cin /2) = 1 — a/2, where 
F‘(-) is the t-distribution with n — 1 degrees of freedom. 

(b) Compute the mean 7 and standard deviation s of the sample. 

(c) Compute k = ty/2s//n. 

(d) The 100(1 — a) percent confidence interval for y is given by 
(e—k,@+ kl}. 
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3. Find the probability of success p for Bernoulli trials with large sample sizes. 


(a) Determine the critical value z,,/2 such that ® (Ze /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 

(b) Compute the proportion p of “successes” out of 7 trials. 

p(l—p) 
—— 

(d) The 100(1 — a) percent confidence interval for p is given by 
[pb — kp +k]. 


(c) Compute k = zy/2 


4. Find variance o? of the normal distribution. 


(a) Determine the critical values y? yo and NG es yo Such that F (x2 >) a 


1—a/2and F (xd -aya) = a/2, where F'(z) is the chi-square distri- 
bution function with n — 1 degrees of freedom. 


(b) Compute the sample standard deviation s. 
— 1)s? — 1)s? 
(c) Compute k; = we and kz = heel 
Xa./2 X1-a./2 
(d) The 100(1 — a) percent confidence interval for 0? is given by [k1, k2]. 
(e) The 100(1 — a) percent confidence interval for the standard deviation 7 


is given by (Vk, Vko|. 
5. Find quantile €, of order p for large sample sizes. 


(a) Determine the critical value z,,/2 such that ® (Ze /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the order statistics 7(1), Z(2),---,2(n)- 


(c) Compute ky = [np — ZajaV np(1 — P| and 


kg = [np =f za/2/ mpl — B)). 
(d) The 100(1 — a) percent confidence interval for € is given by 
[= (41) 2(2)] 
6. Find median MM based on the Wilcoxon one-sample statistic for a large sample. 


(a) Determine the critical value z,,/2 such that ® (Za /2) = 1— a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the order statistics w(1), wi2),..., wi) of the N = n(n—1)/2 
averages (a; + 2;)/2,forl<i<j<n. 
N ZasgN N- ZasoN 
(c) Compute ky = - e | and kz = > + a | 


2 V3n 2 V3n 
(d) The 100(1 — a) percent confidence interval for M is given by 








Wk1)1 ka) J 
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7.10.2 SAMPLES FROM TWO POPULATIONS 


The following confidence intervals assume random samples from two large popula- 
tions: one sample of size n, given by {21,v2,...,%n}, and one sample of size m, 


given by {y1, y2,---,Ym}.- 


parameter assumptions 
independent samples, 
1] fe — Hy | known variances 
independent samples, 
2} [x — My | unknown variances 
independent samples, 


unknown but equal 
variances 





paired samples, 
unknown but equal 
variances 





independent samples, 
Bernoulli trials, large 
samples 


independent samples, 
Mz — My | large samples [G)> M2] 
independent samples, 2 2 
7 o2/o% large samples [SF -ay2, a Fa/2 


1. Find the difference in population means juz and j1,, from independent samples 
with known variances o? and G,. 
(a) Determine the critical value z,,/2 such that ® (2% /2) = 1 — a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the means 7 and 7. 


ge. ok 
(c) Compute k = zy/2\/ = + ay 
nom 


(d) The 100(1 — a) percent confidence interval for uz — fy, is given by 
(= — 9) — k,(@-7) +H. 
2. Find the difference in population means j1, and j1,, from independent samples 
with unknown variances a7, and a7. 





Pu (1—-pe) Py —py) 
P P 4 Py — y 





(a) Determine the critical value z,,/2 such that ® (ae /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the means 7 and ¥, and the standard deviations s,, and sy. 
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s2 82 
(c) Compute k = zy /2\/ = + — 
m 
(d) The 100(1 — a) percent confidence interval for uz — fy is given by 
((- 9) —k, (@-9) + ki. 


3. Find the difference in population means ju, and ju, from independent samples 


with unknown but equal variances 07 = 07. 


(a) Determine the critical value ¢,/2 such that F (ts /2) = 1 — a/2, where 
F‘(-) is the ¢-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means 7 and 7, the standard deviations s, and s,, and the 
pooled standard deviation estimate, 


23 2 = 2 
eng Soe ree (7.10.1) 


/1 1 
(c) Compute k = ty/284/—+—. 
nom 


(d) The 100(1 — a) percent confidence interval for uz — fy is given by 
(- 9) —k, (- 9) + ki. 


4. Find the difference in population means jz and 41, for paired samples with 
2 2 


unknown but equal variances 07, = oy. 

(a) Determine the critical value t,/2 such that F’ (iy /2) = 1 — a/2, where 
F‘(-) is the t-distribution with n — 1 degrees of freedom. 

(b) Compute the mean jig and standard deviation sq of the paired differences 
T1 — Y1,L2 — Y2,-+-,Ln — Yn. 

(c) Compute k = tas sa//N. 

(d) The 100(1 — q) percent confidence interval for 1g = Juz — fly is given 


by [ia _ k, la + k}. 
5. Find the difference in Bernoulli trial success rates, p, — p,, for large, indepen- 
dent samples. 
(a) Determine the critical value z,/2 such that ® (25 /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 


(b) Compute the proportions p,, and p,, of “successes” for the samples. 


De (1 — De D, (1 — Dp, 
(c) Compute k = Ze /2 bu (1 = Pe) Pu) + by (1 = Py) Py) 





n m 
(d) The 100(1 — a) percent confidence interval for p, — py is given by 


6. Find the difference in medians M,, — M, based on the Mann—Whitney— 
Wilcoxon procedure. 





(a) Determine the critical value z,,/2 such that ® (Za /2) = 1— a/2, where 
® (z) is the standard normal distribution function. 
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(b) Compute the order statistics w1), wa),---, Wo) Of the N = nm differ- 
ences x; — yj,forl<i<nandl1<j<m. 
(c) Compute 


nm nm(n+m-+1) 
ky = — : 
1 9 + ° 5 Za/2 12 | 
and 
nm nm(n+m-+1) 
ko = [05.4 a | rs 


(d) The 100(1 — a) percent confidence interval for M/Z, — M, is given by 
[w(er)» Wea) 
7. Find the ratio of variances 0? / oF for independent samples. 


(a) Determine the critical values Fy/2 and Fi_q/2 such that (Fo /2) = 
1—a/2and F (F\_4/2) = a/2, where F(-) is the F-distribution with 
m — 1andn — 1 degrees of freedom. 
(b) Compute the standard deviations s,, and s, of the samples. 
(c) Compute ky = Fy_q/2 and kg = Fy/2. 
(d) The 100(1 — a) percent confidence interval for o3/o7 is given by 
2 2 
E ka, F 
y y 


7.10.3 CONFIDENCE INTERVAL FOR BINOMIAL PARAMETER 


The probability distribution function of a binomial random variable is 
f(an,p) = (“)ora —p)"-® forz =0,1,2,...,n (7.10.2) 
Ha 


For known n, any value of x’ less than n, and a < 1, lower and upper values of p 
(Plower ANd Pupper) May be determined such that Piower < Pupper and 


2 fe 1, Plower) = 5 and x ite 7, Dapper) = 5 (7.10.3) 


The following tables show Pjower ANd Pupper for @ = 0.01 and a = 0.05. 


EXAMPLE Ina binomial experiment having n = 12 trials, a total of = 3 successes 
were observed. Determine a 95% and a 99% confidence interval for the probability of 
a success p. 


From the following tables with n — « = 9 anda = 3 
e 95% confidence: Piower = 0.055 and Pupper = 0.572. Hence, the probability 


is .95 that the interval (0.055, 0.572) contains the true value of p. 
e 99% confidence: Piower = 0.030 and pupper = 0.655. Hence, the probability 
is .99 that the interval (0.030, 0.655) contains the true value of p. 
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Confidence limits of proportions (confidence coefficient 0.95) 
Denominator minus numerator: n — x 
(Lower limit in italic type, upper limit in roman type) 


Denominator minus numerator: n — x 
(Lower limit in italic type, upper limit in roman type) 
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7.10.4 CONFIDENCE INTERVAL FOR POISSON PARAMETER 


The probability density function for a Poisson random variable is 


e £ 


f(x;) = 


For any value of x’ and w < 1, lower and upper values of A (Ajower and Aupper) May 
be determined such that Ajower < Aupper and 





— fora =0,1,2,... (7.10.4) 
Gt 


, 
o e7 Mower a a sd e@~ Aupper Ke a 


lower __ Upper __ 
a mann and a — (7.10.5) 


xz=0 c=a! 
The table below has Ajower ANd Aupper for a = 0.01 and a = 0.05. For x’ > 50, Aupper 
and Atower May be approximated by 








2 
a —— where 1 — F(x?_a.) =, and n = 2(c' +1) 

, (7.10.6) 
Alower = — where F(x2.,) =a, andn = Qa" 


where F'(7) is the cumulative distribution function for a chi-square random variable 
with n degrees of freedom. 


EXAMPLE Ina Poisson process, 5 outcomes are observed during a time interval. Find a 
95% and a 99% confidence interval for the parameter in this Poisson process. 
For an observed count of 5 and a 95% significance level (a = 0.05), the confi- 
dence interval bounds are Ajower = 1.6 and Aupper = 11.7. Hence, the probability is .95 
that the interval (1.6, 11.7) contains the true value of A. 
For an observed count of 5 and a 99% significance level (a = 0.01), the confi- 
dence interval bounds are Ajower = 1.1 and Aupper = 14.1. Hence, the probability is .99 
that the interval (1.1, 14.1) contains the true value of X. 
Confidence limits for the parameter in a Poisson distribution. 


Significance level Significance level 
Observed =0. | x = 0.05 | Observed 
count count 


0 
1 
2 
3 
4 
5 
6 
7 
8 
9 


= 
oO 





7.11. TESTS OF HYPOTHESES 595 





7.11. TESTS OF HYPOTHESES 


A statistical hypothesis is a statement about the distribution of a random variable. A 
statistical test of a hypothesis is a procedure in which a sample is used to determine 
whether we should “reject” or “not reject” the hypothesis. Before employing a hy- 
pothesis test, first select a significance level a. The significance level of a test is the 
probability of mistakenly rejecting the null hypothesis. Typically, a is 0.05 or 0.01 
(i.e, 5% or 1%) or similar. 


7.11.1. HYPOTHESIS TESTS: PARAMETER FROM ONE 
POPULATION 


The following hypothesis tests assume a random sample of size n, given by 
{x1, LQ +045 Ln}. 


1. Test of the hypothesis jz = jo against the alternative jz ~ jp of the mean of a 


normal distribution with known variance o?: 


(a) Determine the critical value z,/2 such that ® (z,/2) = 1 — a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the mean 7 of the sample. 


(Z = Ho) vin 


(d) If|z| > zq/2, then reject the fiypaiies If |z| < zq/2, then do not reject 
the hypothesis. 


(c) Compute the test statistic z = 


2. Test of the hypothesis 4 = jo against the alternative ps > pio (or pb < jo) of 


the mean of a normal distribution with known variance o?: 


(a) Determine the critical value z,, such that ® (z,) = 1 — a, where ® (z) is 
the standard normal distribution function. 
(b) Compute the mean 7 of the sample. 


(c) Compute the test statistic z = (= Ho) Vn (For the alternative ju < jo, 
o 


multiply z by —1.) 
(d) If z > 2, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


3. Test of the hypothesis 4. = jo against the alternative p» A [4c of the mean of a 


normal distribution with unknown variance o?: 


(a) Determine the critical value t,/2 such that F (ta /2) = 1 — a/2, where 


F°(-) is the ¢-distribution with n — 1 degrees of freedom. 
(b) Compute the mean Z and standard deviation s of the sample. 


(T= Ho) Vn 


(d) If |¢| > ta,2, then reject the ipatheas If |t| < ta/2, then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 
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4. Test of the hypothesis 1 = fo against the alternative ps > fio (or pp < pg) of 
the mean of a normal distribution with unknown variance o?: 


(a) Determine the critical value ty such that F’ (t..) = 1 — a, where F(-) is 
the ¢-distribution with n — 1 degrees of freedom. 
(b) Compute the mean Z and standard deviation s of the sample. 


ras n 
(c) Compute the test statistic t = (= Ho) Vr (For the alternative ju < jo, 
Ss 


multiply ¢ by —1.) 
(d) If t > tq, then reject the hypothesis. If t < tq, then do not reject the 
hypothesis. 


5. Test of the hypothesis p = po against the alternative p 4 po of the probability 
of success for a binomial distribution, large sample: 


(a) Determine the critical value z,/2 such that ® (2, /2) = 1— a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the proportion p of “successes” for the sample. 
P— Po 


(c) Compute the test statistic z = 
po(1—~po) 


(d) If |z| > zq,2, then reject the hypothesis. If |z| < z,,2, then do not reject 
the hypothesis. 


6. Test of the hypothesis p = po against the alternative p > po (or p < po) of the 
probability of success for a binomial distribution, large sample: 


(a) Determine the critical value z such that ® (z_) = 1— a, where ® (z) is 
the standard normal distribution function. 

(b) Compute the proportion p of “successes” for the sample. 

(c) Compute the test statistic z = ae, (For the alternative p < po, 


po(1—po) 
n 


multiply z by —1.) 
(d) If z > Zq, then reject the hypothesis. If z < zq, then do not reject the 
hypothesis. 


7. Wilcoxon signed rank test of the hypothesis IZ = Mp against the alternative 
M #4 Mo of the median of a population, large sample: 


(a) Determine the critical value z,/2 such that ® (2, /2) = 1— a/2, where 
® (z) is the standard normal distribution. 

(b) Compute the quantities |2; — Mo|, and keep track of the sign of x; — Mp. 
If |x; — Mo| = 0, then remove it from the list and reduce n by one. 

(c) Order the |2; — Mo| from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; |a; — Mo| has rank r; if it is the oa 
entry in the ordered list. In case of ties (i.e., |2; — Mo| = |x; — Mo| for 
2 or more values) assign each the average of their ranks. 








(d) Compute the sum of the signed ranks R = » sign (a; — Mo) rj. 
i=l 
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R 


(e) Compute the test statistic z = —————____. 
n(n+1)(2n+1) 


6 
(f) If|z| > 2,2, then reject the hypothesis. If |z| < z./2, then do not reject 
the hypothesis. 
8. Wilcoxon signed rank test of the hypothesis 1 = Mo against the alternative 
M > Mo (or M < Mo) of the median of a population, large sample: 


(a) Determine the critical value z. such that ® (z_) = 1 — a, where ® (z) is 
the standard normal distribution. 

(b) Compute the quantities |2; — Mo|, and keep track of the sign of x; — Mo. 
If |x; — Mo| = 0, then remove it from the list and reduce n by one. 

(c) Order the |x; — Mo| from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; |v; — Mo| has rank r; if it is the rit 
entry in the ordered list. If |z; — Mo| = |x; — Mol, then assign each the 
average of their ranks. 








(d) Compute the sum of the signed ranks R = - sign (a; — Mo) rj. 
i=1 
(e) Compute the test statistic z = -————————._ (For the alternative 
n(n+1)(2n+1) 
6 
M < Mo, multiply the test statistic by —1.) 
(f) If z > Za, then reject the hypothesis. If z < za, then do not reject the 


hypothesis. 


9. Test of the hypothesis o? 


of a normal distribution: 


= o@ against the alternative 0? 4 o@ of the variance 


(a) Determine the critical values x? jo and Ves yo Such that F° (2 a) = 


1—a/2and F (apa) = a/2, where F'\(-) is the chi-square distribu- 
tion function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

(n — 1)s? 
a 

(d) If x? < Xt o/2 ory > Loa then reject the hypothesis. 


(c) Compute the test statistic y? = 


(e) If Xt_a/2 <x?< Vere then do not reject the hypothesis. 


10. Test of the hypothesis 0? = o? against the alternative 0? > 09 (or 0? < of) 
of the variance of a normal distribution: 


(a) Determine the critical value y? (y7_, for the alternative 7? < 0%) such 
that F (x2) = 1—a (F (x7_,) = @), where F(-) is the chi-square 
distribution function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

(n — 1)s? 
oF 

(d) If x? > x2, (Xx? < x7_q), then reject the hypothesis. 

(e) If x? < x2 (v?_, < x”), then do not reject the hypothesis. 


(c) Compute the test statistic y? = 
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7.11.2 HYPOTHESIS TESTS: PARAMETERS FROM TWO 


POPULATIONS 
The following hypothesis tests assume a random sample of size n, given by 
{x1,@2,..., &,}, and a random sample of size m, given by {y1, y2,---,Ym}. The 


term “large sample” means that the underlying distribution is approximated well 
enough by a normal distribution. 


1. Test of the hypothesis ju. = /4, against the alternative ji. A {1 of the means 


of independent normal distributions with known variances o? and oF : 


(a) Determine the critical value z,./2 such that ® (Za /2) = 1—a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the means, % and 7, of the samples. 


z= 
(c) Compute the test statistic z = y 


(d) If |z| > zq,2, then reject the hypothesis. If |z| < z,2, then do not reject 
the hypothesis. 


2. Test of the hypothesis jz. = j1, against the alternative pz, > py (OF fe < fly) 
of the means of independent normal distributions with known variances o2 
and oy : 

(a) Determine the critical value z. such that ® (z_) = 1— a, where ® (z) is 
the standard normal distribution function. 
(b) Compute the means % and 7 of the samples. 


_ rt 
(c) Compute the test statistic z = y 


. (For the alternative pig < ply, 
multiply z by —1.) 

(d) If z > 2, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


3. Test of the hypothesis juz = /1y against the alternative ju, A jt, of the means 
of independent normal distributions with unknown variances 02 and a large 
sample: 

(a) Determine the critical value z,/2 such that ® (Ze /2) = 1—a/2, where 
® (z) is the standard normal distribution. 
(b) Compute the means, % and y, and standard deviations, Ce and a of the 


samples. 
(c) Compute the test statistic z = =e = 
s? s 
cae 
(d) If |z| > zq/2, then reject the hypothesis. If |z| < zq/2, then do not reject 


the hypothesis. 
4. Test of the hypothesis ji. = j1, against the alternative pu. > fy (OF Uz < My) 
of the means of independent normal distributions with unknown variances, ie 
and o%, large sample: 
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(a) Determine the critical value z. such that ® (z_) = 1— a, where ® (z) is 
the standard normal distribution function. 

(b) Compute the means, 7 and 7, and standard deviations, s? and a of the 
samples. 

we E—Y 

(c) Compute the test statistic z = 


. (For the alternative piz < fly, 
multiply z by —1.) 

(d) If z > Za, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


5. Test of the hypothesis juz = sty against the alternative ju. # [Wy of the means 
of independent normal distributions with unknown variances o2 = O, : 
(a) Determine the critical value t,/2 such that F (ta/2) = 1 — a/2, where 
F°(-) is the ¢-distribution with n + m — 2 degrees of freedom. 
(b) Compute the means, % and y, and standard deviations, Ce and a of the 


samples. 
z-9 


n—1)s2+(m-1 82 / , 
ye = sir * 
(d) If |¢| > ta,g, then reject the hypothesis. If |] < ¢../2, then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 


6. Test of the hypothesis zz = 1, against the alternative uz > fly (Or Uz < 
/4y) of the means of independent normal distributions with unknown variances 
o2=08: 

(a) Determine the critical value ty such that F’ (t..) = 1 — a, where F(-) is 
the t-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means, % and Y, and standard deviations, st and co of the 
samples. 

T-Y 


/ (n—1)s2+(m—1)s2 1 
n+m—2 n a 
alternative ju. < jy, multiply ¢ by —1.) 
(d) If t > tq, then reject the hypothesis. If ¢ < t,, then do not reject the 


hypothesis. 


(c) Compute the test statistic t = . (For the 


ale 


7. Test of the hypothesis ju. = /1, against the alternative ji, A j1, of the means 
of paired normal samples: 


(a) Determine the critical value t,/2 so that F (ta/2) = 1—a/2, where F(-) 
is the t-distribution with n — 1 degrees of freedom. 

(b) Compute the mean, jig, and standard deviation, sq, of the differences 
Z1 — Y1,L2 — Y2,---,%n — Yn- 


fra/n 


Sd 
(d) If |¢| > ta,2, then reject the hypothesis. If |t) < t./2, then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 
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8. Test of the hypothesis wz = py against the alternative fiz > ply (OF fe < fy) 
of the means of paired normal samples: 


(a) Determine the critical value t, so that F' (ta) = 1— a, where F(-) is the 
t-distribution with n — 1 degrees of freedom. 
(b) Compute the mean, fig, and standard deviation, sq, of the differences 


Z1 — Y1, 22 — Y2,.--,Ln — Yn. 
fran 


Sd 


(c) Compute the test statistic tf = . (For the alternative pz < py, 


multiply ¢ by —1.) 
(d) If t > tq, then reject the hypothesis. If t < tq, then do not reject the 
hypothesis. 


9. Test of the hypothesis pz = p, against the alternative p, # py of the proba- 
bility of success for a binomial distribution, large sample: 


(a) Determine the critical value z,,/2 such that ® (Za /2) = 1— a/2, where 
® (z) is the standard normal distribution function. 
(b) Compute the proportions, p, and p,, of “successes” for the samples. 
Da ~ Py 
be(—pe) | PyU~py) 
beta t _ Belt pat 


(c) Compute the test statistic z = 


(d) If|z| > zq/2, then reject the hypothesis. If |z| < zq/2, then do not reject 
the hypothesis. 


10. Test of the hypothesis p, = p, against the alternative py > py (or py < py) of 
the probability of success for a binomial distribution, large sample: 


(a) Determine the critical value z,, such that ® (z,) = 1 — a, where ® (z) is 
the standard normal distribution function. 

(b) Compute the proportions, p, and p,, of “successes” for the samples. 

Pa = Py 


(c) Compute the test statistic z = : 
Be(l=pe) 4 Py—py 
n 


. (Multiply it by 
—1 for the alternative pz < py.) 
(d) If z > 2, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


11. Mann—Whitney—Wilcoxon test of the hypothesis M/;, = M, against the alter- 
native M, # M, of the medians of independent samples, large sample: 


(a) Determine the critical value z,,/2 such that ® (Zu /2) = 1— a/2, where 
® (z) is the standard normal distribution. 

(b) Pool the N = m+ n observations, but keep track of which sample the 
observation was drawn from. 

(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r; if 
it is the r entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 

(d) Compute the sum of the ranks from the first sample T;,. 
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_— m(N+1) 
2 


(e) Compute the test statistic z = } 
mn(N+1) 
T2 


(f) If |z| > 2/2, then reject the hypothesis. If |z| < zq/2, then do not reject 
the hypothesis. 


12. Mann—Whitney—Wilcoxon test of the hypothesis M/;, = M, against the alter- 
native M,, > M, (or M, < M,) of the medians of independent samples, large 
sample: 


(a) Determine the critical value z, such that ® (z,) = 1— a, where ® (z) is 
the standard normal distribution. 

(b) Pool the N = m+ n observations, but keep track of which sample the 
observation was drawn from. 

(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r; if 
it is the r entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 


(d) Compute the sum of the ranks from the first sample T;,. 
_ m(N+1) 


(e) Compute the test statistic z = a (For the alternative MM, < 
mn(N+1) 
T2 
M,, multiply the test statistic by —1.) 


(f) If |z| > za, then reject the hypothesis. If |z| < z., then do not reject the 
hypothesis. 
13. Wilcoxon signed rank test of the hypothesis /, = M, against the alternative 
M, # M, of the medians of paired samples, large sample: 


(a) Determine the critical value z,/2 such that ® (34 /2) = 1 —a/2, where 
® (z) is the standard normal distribution. 

(b) Compute the paired differences d; = x; — y;, fori = 1,2,...,n. 

(c) Compute the quantities |d;| and keep track of the sign of d;. If d; = 0, 
then remove it from the list and reduce n by one. 

(d) Order the |d;| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |d;| has rank r; if it is the r" entry in the ordered 
list. In case of ties (i.e., |d;| = |d;| for 2 or more values) assign each the 
average of their ranks. 





(e) Compute the sum of the signed ranks R = 2 sign (d;) rj. 
i=1 


(f) Compute the test statistic z = ———____.. 
mint Got) 
(g) If|z| > za/2, then reject the hypothesis. If |z| < zq/2, then do not reject 
the hypothesis. 
14. Wilcoxon signed rank test of the hypothesis /, = M, against the alternative 
M, > M, (or M; < M,,) of the medians of paired samples, large sample: 


(a) Determine the critical value z_ such that ® (z_) = 1— a, where ® (z) is 
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the standard normal distribution. 

(b) Compute the paired differences d; = x; — y;, fori = 1,2,...,n. 

(c) Compute the quantities |d;| and keep track of the sign of d;. If d; = 0, 
then remove it from the list and reduce n by one. 

(d) Order the |d;| from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; |d;| has rank r; if it is the r" entry in the ordered 
list. In case of ties (i.e., |d;| = |d;| for 2 or more values) assign each the 
average of their ranks. 





(e) Compute the sum of the signed ranks R = S- sign (d;) rj. 
i=1 


R 
(f) Compute the test statistic z = ———————.. (For the alternative 
n(n+1)(2n+1) 
6 
My < My, multiply the test statistic by —1.) 


(g) If z > 2, then reject the hypothesis. If z < za, then do not reject the 
hypothesis. 


15. Test of the hypothesis 0% = 07 against the alternative 0% # 0% (or 07 > 07) 
of the variances of independent normal samples: 
(a) Determine the critical value Fy /2 (fq for the alternative o > o;) such 
that F (Fy/2) = 1-0/2 (F (Fy) = 1), where F(-) is the F- 
distribution function with n — 1 and m — 1 degrees of freedom. 


(b) Compute the standard deviations s,, and s, of the samples. 
2 


(c) Compute the test statistic F = es (For the two-sided test, put the larger 
Sy 
value in the numerator.) 
(d) If PF > Faso (F > FQ), then reject the hypothesis. If F< Fuso (F< 


F), then do not reject the hypothesis. 


7.11.3. HYPOTHESIS TESTS: DISTRIBUTION OF A 
POPULATION 


The following hypothesis tests assume a random sample of size n, given by 
{x1, LQ +045 Dinh 


1. Run test for randomness of a sample of binary values, large sample: 


(a) Determine the critical value z,/2 such that ® (2 /2) = 1— a/2, where 
® (z) is the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of x; by 0 and 1. 
Count the total number of zeros, and call this n;; count the total number 
of ones, and call this nz. Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 

2niN2 +1,and 02 = (ar—D(UR-2) | 


(c) Compute Rp = ha te nmi+n2—1 
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R- 
(d) Compute the test statistic z = ee 
OR 
(e) If|z| > 2/2, then reject the hypothesis. If |z| < 2. 2, then do not reject 
the hypothesis. 


2. Run test for randomness against an alternative that a trend (an association be- 
tween two variables) is present in a sample of binary values, large sample: 


(a) Determine the critical value z, such that ® (z,) = 1— a, where ® (z) is 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of x; by 0 and 1. 
Count the total number of zeros, and call this n;; count the total number 
of ones, and call this nz. Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 


2ning 2 _ (#r-1)(ur—2) 
(c) Compute wR = i ie +1, m oR mi +na—-1 
(d) Compute the test statistic z = ee 
OR 


(e) If z < —Zg, then reject the hypothesis (this suggests the presence of a 
trend in the data). If z > —zq, then do not reject the hypothesis. 


3. Run test for randomness against an alternative that the data are periodic for a 
sample of binary values, large sample: 


(a) Determine the critical value z. such that ® (z_) = 1— a, where ® (z) is 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of x; by 0 and 1. 
Count the total number of zeros, and call this n;; count the total number 
of ones, and call this nz. Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 


Aran? 4 1 and o}, = a= Wun—2), 


(c) Compute 4p = ———— 
ny + ne 


R— 
(d) Compute the test statistic z = ee 
OR 
(e) If z > 2, then reject the hypothesis (this suggests the data are periodic). 


If z < Zq, then do not reject the hypothesis. 


4. Chi-square test that the data are drawn from a specific k-parameter multino- 
mial distribution, large sample: 


(a) Determine the critical value x2, such that F (x2) = 1 — a, where F'(2) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The k-parameter multinomial has k possible outcomes Aj, Ag, ..., Ax 
with probabilities p;,p2,...,px. For? = 1,2,...,k, compute n,, the 
number of x;’s corresponding to Aj. 

(c) For? = 1,2,...,4, compute the sample multinomial parameters p; = 
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k 2 
(d) Compute the test statistic x? = y (ri = rps) 
. Npi 
i=1 
(e) If vy? > x2, then reject the hypothesis. If x? < y2, then do not reject 


the hypothesis. 


5. Chi-square test for independence of attributes A and B having possible out- 
comes Aj, Ao,..., Az, and By, Bo,...,Bm: 


(a) Determine the critical value x2, such that F (x2) = 1— a, where F(-) 
is the chi-square distribution with (k — 1)(m — 1) degrees of freedom. 
(b) For? = 1,2,...,k andj = 1,2,...,m, define 0;; to be the number of 
observations having attributes A; and B;, and define 0;. = bes 1, Oi; and 
jJ= 
k 
0.5 = dyiai M9: 
(c) The variables defined above are often collected into a table, called a con- 
tingency table: 


Awwibute[ By By By | Totals) 





(d) For i = 1,2,...,k and 7 = 1,2,...,m, compute the sample mean 
number of observations in the ij" cell of the contingency table 
Oj. 0.5 
ej; = —. 
UW n 
kom Cs 
(e) Compute the test statistic, y? = OO 


(f) If x? > x2, then reject the hypothesis (that is, conclude that the attributes 
are not independent). If .? < 2, then do not reject the hypothesis. 
6. Kolmogorov—Smirnov test that Fo (2) is the distribution of the population from 
which the sample was drawn: 
(a) Determine the critical value D, such that Q(D,) = 1— a, where Q(D) 
is the distribution function for the Kolmogorov-Smirnov test statistic D. 
(b) Compute the sample distribution function F'(). 
(c) Compute the test statistic, given the maximum deviation of the sample 


nxn 


and target distribution functions D = max | F(a) — Fo(x) . 
(d) If D > Dg, then reject the hypothesis (that is, conclude that the data are 
not drawn from Fo(a)). If D < Da, then do not reject the hypothesis. 
7.11.4 HYPOTHESIS TESTS: DISTRIBUTIONS OF TWO 
POPULATIONS 


The following hypothesis tests assume a random sample of size n, given by 
{x1,@2,...,£n}, and a random sample of size m, given by {y1, y2,---;Ym}- 
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1. Chi-square test that two k-parameter multinomial distributions are equal, large 
sample: 


(a) Determine the critical value 2, such that F (x2) = 1 — a, where F(-) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The k-parameter multinomials have & possible outcomes Aj, Ag, ..., 
A,. For i = 1,2,...,k, compute n;, the number of x;’s corresponding 
to A;, and compute m,, the number of y;’s corresponding to Aj. 

(c) Forti = 1,2,...,4, compute the sample multinomial parameters 
Bi = (mi + mi)/(n +m). 

(d) Compute the test statistic, 


2 3 (nj — np;)? it (TAL) 
a Ni — 


i=l i=1 


(e) If x? > x2, then reject the hypothesis. If y? < 2, then do not reject 
the hypothesis. 


2. Mann—Whitney—Wilcoxon test for equality of independent continuous distri- 
butions, large sample: 


(a) Determine the critical value z,/2 such that ® es /2) = 1—a/2, where 
® (z) is the normal distribution function. 

(b) For? = 1,2,...,n andj = 1,2,...,m, define S;; = 1 if x; < y; and 
Si; = Oif x; > y;. (Continuous distributions will not produce a tie.) 

(c) Compute U = S71 Oye Siz. 


1 
(d) Compute the test statistic z = (u _ ot) / a 
(e) If |z| > 2/2, then reject the hypothesis. If |z| < 2. 2, then do not reject 


the hypothesis. 
3. Spearman rank correlation coefficient for independence of paired samples, 
large sample: 


(a) Determine the critical value R,./2 such that F’ (Ra /2) = 1—a/2, where 
F (R) is the distribution function for the Spearman rank correlation co- 


efficient. 
(b) The samples are ordered, with the smallest 7; assigned the rank r; and 
the largest assigned the rank r,,; fori = 1,2,...,n, x; is assigned rank 


r; if it occupies the i position in the ordered list. Similarly the y;’s are 
assigned ranks s;. In case of a tie within a sample, the ranks are averaged. 
(c) Compute the test statistic 


4 Tisp— 4 e) ei si) 


R= 





(n Sent ~ oe ri’) (n ier (a si) | 


(d) If |R| > Rave, then reject the hypothesis. If |R| < Ra 2, then do not 
reject the hypothesis. 
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7.11.5 THE RUNS TEST 


A run is a maximal subsequence of elements with a common property. The runs test 
uses the hypotheses 


Hy: the sequence is random 
; (7.11.2) 
H,: the sequence is not random 


The decision variable V is the total number of runs. The hypothesis of randomness 
(Ho) is rejected when V > v1 or V < v2 where where v1 and v2 are critical values 
for the runs test. 


EXAMPLE Flipping a coin gave the following sequence of heads (H) and tails (T): {H, 
H,T,T, H,T, H,T,T,T, T, H}. Is the coin biased? Writing the sequence as 
HH|TT|H|T|H|TTTT | A | shows that there are m = 5 H’s,n = 7 T’s, 
and V = 7 runs. 

The table (form = 5 and n = 7) indicates that 65% of the time one would expect 
there to be 7 runs or fewer. The table (for m = 5 and n = 6) indicates that 42% of the 
time one would expect there to be 6 runs or fewer. Hence, 58% (since 1 — 0.42 = 0.58) 
of the time there would be 7 runs or more. 

Hence, there is no evidence to suggest the coin is biased. 


Ws NNNNYNYNYNYNN 
OMANDHDNAHW PLP 


3,3 
3,4 
3,9 
3,6 
3,4 
3,8 
3,9 


PRPS HSF 
COCMANDUNAF 
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0.0022)0.0130]0.0671]0.1753]0.3918]0.6082 
0.0012)0.0076]0.0425)0.1212]0.2960)0.5000 
0.0007) 0.0047}0.0280]0.0862]0.2261]0.4126 


0.0004) 0.0030}0.0190] 0.0629] 0.1748]0.3427 
0.0002]0.0020}0.0132]0.0470]0.1369]0.2867 


0.0006) 0.004 1}0.025 1}0.0775]0.2086]0.3834 
0.0003) 0.0023}0.015410.0513]0.1492]0.2960 
0.0002]0.0014/0.0098] 0.0350] 0.1084]0.2308 


0.0002]0.0012/0.0089}0.0317)0.1002}0.2145 
.04823|0.0007|0.0053]0.0203]0.0687]0.1573 





When m = n and m > 10 the following table can be used. The columns headed 
0.5, 1, 2.5, and 5 give values of v such that v or fewer runs occur with probability 
less than the indicated percentage. For example, form = n = 12, the probability 
of 8 or fewer runs is approximately 5%. The columns headed 95, 97.5, 99, and 99.5 
give values of v for which the probability of v or more runs is less than 5, 2.5, 1, or 
0.5%. The last columns describe the expected number of runs (j1, 7). 


memes 1.0 2.5 5.0 ae aE: Dt = eae 
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7.11.6 SEQUENTIAL PROBABILITY RATIO TESTS 


When using a sequential probability ratio test, the number of samples taken is not 
fixed a priori, but determined as sampling occurs. Given two simple hypotheses and 
m observations, compute: 


1. Pom = Prob (observations | Ho). 
2. Pim = Prob (observations | H;). 
3: Um = Pim/Pom- 


And then make one of the following decisions: 





1. Ifum > B then reject Ho. 


a 
2. IfUm < i E 


1— 
B < Um < B 
l-a a 


EXAMPLES 


1. Let X be normally distributed with unknown mean py and known standard deviation o. 
Consider the two simple hypotheses, Ho : js = fo and Hy: w = pr. If Y is the sum 
of the first m observations of X, then a (Y,m) control chart is constructed with the 


two lines: ra 2 
y= Hot Hi wae 


2 La — jo l-a 
2 
Yor c = 7 ‘ 
2 Li — Lo a 
2. Let @ denote the fraction of defective items. Two simple hypotheses are Ho: 6 = 00 = 
0.05 and Hi: 6 = 6; = 0.15. Choose a = 5% and 6B = 10% (i.e., reject lot with 
0 = 9 about 5% of the time; accept lot with 0 = 0; about 10% of the time). If, after 
m observations, there are d defective items, then 


mm Oy @ 1 01 maa 
; a d _Q. m—d _ vt =e 
Px (";) ota 0:) and Um (2) (>) (7.11.4) 


Or Um = 37(0.895)™"—4, with the above numbers. We find = = 0.105 and i = 
18. The decision to perform another observation depends on whether or not 





then reject H,. 


3. If then make another observation. 

















(7.11.3) 




















0.105 < 34(0.895)"~* < 18. (7.11.5) 


Taking logarithms, a (m — d, d) control chart can be drawn with the following lines: 
d = 0.101(m — d) — 2.049 and d = 0.101(m — d) + 2.63. On the figure below, a 
sample path leading to rejection of Ho has been indicated: 


(defeeayes) 





Reject Hy 





n — d (non-defectives) 
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7.12 LINEAR REGRESSION 


1. The general linear statistical model assumes that the observed data values 
{y1,Y2,--+,Ym} are of the form 


Yi = Po + Biv + Botig +--+ + Brin + &, 


fori = 1,2,...,m. 

2. Fora = 1,2,...,m andj = 1,2,...,m, the independent variables x;; are 
known (nonrandom). 

3. {Bo, 81, 82,--+ ,B,} are unknown parameters. 

4. For each 7, €; 18 a zero-mean normal random variable with unknown vari- 
ance o?. 


7.12.1. LINEAR MODEL y; 


1. Point estimate of (1: 


Bot+ fizi te 


2. Point estimate of {o: > 7 
Bo=¥- fiz. 


3. Point estimate of the correlation coefficient: 





m 


x a 2 
5 (vi — Bo - B,2i) 
4. Point estimate of error variance 02: ¢2 = ={/——________. 


m—2 
5. The standard error of the estimate is defined as s. = V of, 
6. Least-squares regression line: y¥ = 80+ fie. 
7. Confidence interval for {o: 
(a) Determine the critical value ¢,/2 such that F’ bt /2) = 1 — a/2, where 


F'(-) is the cumulative distribution function for the t-distribution with 
m — 2 degrees of freedom. 
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(b) Compute the point estimate Bo. 


(c) Compute k = ty/28¢ 





(d) The 100(1 — a) percent confidence interval for 89 is given by 
[Bo — , By +h}. 
8. Confidence interval for (1: 


(a) Determine the critical value f,,/2 such that F’ (ts /2) = 1—a/2, where 
F'(-) is the cumulative distribution function for the ¢-distribution with 
m — 2 degrees of freedom. 

(b) Compute the point estimate Ar. 

(c) Compute k = ty/2 = 





(d) The 100(1 — a) percent confidence interval for 6; is given by 
[i —k, By +k]. 
9. Confidence interval for 07: 
(a) Determine the critical values y? yo and Nie jo Such that F (2 jf) a 
1—a/2and F (eas) = a/2, where F (-) is the cumulative distribu- 
tion function for the chi-square distribution function with m — 2 degrees 


of freedom. a 
(b) Compute the point estimate o?. 
— 2)q2 — 2)q2 
(c) Compute k; = deal and ky = lee eas 
Xo/2 X1—a/2 


(d) The 100(1 — a) percent confidence interval for 0? is given by [k1, kz]. 


10. Confidence interval (predictive interval) for y, given xo: 
(a) Determine the critical value ¢,,/2 such that F’ (es /2) = 1-—a/2, where 
F(-) is the cumulative distribution function for the t-distribution with 
m — 2 degrees of freedom. 
(b) Compute the point estimates 59, 61, and se. 


(c) Compute k = ty/2Se and y = Bo + Biz. 





(d) The 100(1 — a) percent confidence interval for 6; is given by 
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11. Test of the hypothesis 3; = 0 against the alternative 6, 4 0: 


(a) Determine the critical value t,/2 such that F (ta/2) = 1— a/2, where 
F'(-) is the cumulative distribution function for the t-distribution with 
m — 2 degrees of freedom. 

(b) Compute the point estimates By and Se. 

_ Pr 

(c) Compute the test statistic t = rs 





(d) If |¢| > ta,2, then reject the hypothesis. If |t] < t./2, then do not reject 
the hypothesis. 


7.12.2 GENERAL MODEL y = fo + Biz + Bote + +++ + Bntn t€ 


1. The m equations (2 = 1,2,...,m) 





Ui = Bo + Givi + Pomig ++>>+ Patina + (7.12.1) 


can be written in matrix notation as y = X{ + € where 


Y1 Bo €1 
Y2 By €2 
y=|.|, 6=|. c=]. |, (7.12.2) 
Ym Bn Em 
and 
il C11 U1 ttt Lin 
1 21 22 sth Lan 
ci . = . al (7.12.3) 
1 Zm1 m2 set Limn 


2. Throughout the remainder of the section, we assume X has full column rank 
(see page 93). 
3. The least-squares estimate B satisfies the normal equations xX'x@ = X’y. 
That is, 8 = (X™X)~* XTy. 
4. Point estimate of o?: 
————— (v'y- 8 (xTy)). 
m—n—-1 
. The standard error of the estimate is defined as s. = ae ’ 
. Least-squares regression line: 7 = x". 
. In the following, let c;; denote the (i, j) entry in the matrix (X"X) ~ 
. Confidence interval for (;: 


on aN 
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(a) Determine the critical value t,/2 such that F' (i /2) = 1 — a/2, where 
F'(-) is the cumulative distribution function for the ¢-distribution with 
m — n— | degrees of freedom. 

(b) Compute the point estimate B: by solving the normal equations, and 
compute Se. 

(c) Compute kj = ta/28eV/Cii- 

(d) The 100(1 — a) percent confidence interval for 8; is given by 


E — ki, By + ki] : 
9. Confidence interval for 7: 


(a) Determine the critical values x? jo and cae ya Such that F (2 a) = 


1—a/2and F Ca = a/2, where F'(-) is the cumulative distri- 
bution function for the chi-square distribution function with m — n — 1 
degrees of freedom. 

(b) Compute the point estimate a, 


ia 

(c) Compute kh; = ce and ky = 5 
Xa/2 X1-a/2 

(d) The 100(1 — a) percent confidence interval for 0? is given by [k1, ka]. 


10. Confidence interval (predictive interval) for y, given Xo: 


(a) Determine the critical value t,/2 such that F’ (ta /2) = 1— a/2, where 
F'(-) is the cumulative distribution function for the t-distribution with 
n — m — | degrees of freedom. 

(b) Compute the point estimate Bi by solving the normal equations, and 
compute Se. 


(c) Compute k = ta/2 Se \/1+xg xx) Xo and 7 = xb B. 
(d) The 100(1 — a) percent confidence interval for yo is given by 


11. Test of the hypothesis 8; = 0 against the alternative 6; A 0: 


(a) Determine the critical value ¢,/2 such that F’ (he /2) = 1 — a/2, where 
F'(-) is the cumulative distribution function for the t-distribution with 
m —n— 1 degrees of freedom. 

(b) Compute the point estimates Bi and Se by solving the normal equations. 

Bi 

Ban Ga 

(d) If |¢| > ta,2, then reject the hypothesis. If |t) < t./2, then do not reject 
the hypothesis. 


(c) Compute the test statistic t = 





7.13. ANALYSIS OF VARIANCE (ANOVA) 613 





7.13 ANALYSIS OF VARIANCE (ANOVA) 


Analysis of variance (ANOVA) is a statistical methodology for determining informa- 
tion about means. The analysis uses variances both between and within samples. 


7.13.1. ONE-FACTOR ANOVA 


1. Suppose we have k samples from k populations, with the j" population con- 
sisting of n; observations, 
Y11, Y21>-++> Ynil 
Y12> Y22,-++5 Yno2 


Ylk> Y2ks -++5 Yngk 
2. One-factor model: 

(a) The one-factor ANOVA assumes that the 7" observation from the hi 
sample is of the form yj; = pu +7; + e;;. 

(b) For 7 = 1,2,...,k, the parameter 4; = ps + 7; is the unknown mean of 
the j" population, and ae r= 0, 

(c) For? = 1,2,...,k andj = 1,2,...,n,;, the random variables e;; are 
independent and normally distributed with mean zero and variance o?. 

(d) The total number of observations isn = n, + n2+---+ nk. 


3. Point estimates of means: 


k Nj 
~ 1 
(a) Total sample mean y= a s Yiz- 
Te pA aa 
(b) Sample mean of j sample qj = kes 3 Yas 
a tes = oe 
4. Sums of squares: P 
(a) Sum of squares between samples SSp = S- n; (Yj — 9)’. 
j=l 
k Ng ; 
(b) Sum of squares within samples SSy = D ys (Yaz — 9j;)°. 
j=l i=1 
ko nj 
(c) Total sum of squares Total SS = 2 S- (Yaz — 9). 
j=l i=l 
(d) Partition of total sum of squares Total SS = SS, + SSy. 


5. Degrees of freedom: 
(a) Between samples, & — 1. 
(b) Within samples, n — k. 
(c) Total, n — 1. 
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6. Mean squares: 


(a) Obtained by dividing sums of squares by their respective degrees of 








freedom. 86 
(b) Between samples, MS, = E : T 
SSw 
(c) Within samples (also called the residual mean square), MSy = i 
n— 
7. Test of the hypothesis 41 = pug = = [4p against the alternative p14; A ju; for 
some 7 and 7; equivalently, test the null hypothesis 7; = 72 T, = 0 








against the hypothesis 7; 4 0 for some J: 


(a) Determine the critical value F, such that F' (Ff) = 1 — a, where F'(-) 
is the cumulative distribution function for the F’-distribution with k — 1 
and n — k degrees of freedom. 

(b) Compute the point estimates y and Y; for j = 1,2,...,k. 

(c) Compute the sums of squares SS» and SS,,. 

(d) Compute the mean squares MS, and MS,,. 

MS» 





(e) Compute the test statistic F’ = 


MSy_ 
(f) If fF > Fa, then reject the hypothesis. 
If F' < F4, then do not reject the hypothesis. 
(g) The above computations are often organized into an ANOVA table: 


DOR_MS 


Between samples MS, | F = a 
Within samples n— i MSy 





Tal SS HT 


8. Confidence interval for ju; — pj, for i A 7: 


(a) Determine the critical value ¢,/2 such that F (ie /2) = 1 — a/2, where 
F'(-) is the cumulative distribution function for the t-distribution with 
n — k degrees of freedom. 

(b) Compute the point estimates y; and ¥;. 

(c) Compute the residual mean square MS,. 


1 1 
(d) Compute k = ty/24/MSw (— + ~). 
NG Nh 
(e) The 100(1 — a) percent confidence interval for uw; — 4; is given by 
[Hi — ys) — &, Yi — yy) + Al. 


9. Confidence interval for contrast in the means, defined by C = c1 4, + cof2 + 
+++ Celie, Where c) + co +--+: +c, =0: 


(a) Determine the critical value F, such that F' (F,) = 1 — a, where F '(-) 
is the cumulative distribution function for the F’-distribution with & — 1 
and n — k degrees of freedom. 

(b) Compute the point estimates 7; for 7 = 1,2,...,k. 
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(c) Compute the residual mean square MS,,. 


(d) Compute k = 





(e) The 100(1 — a) percent confidence interval for the contrast C’ is 


k k 
Sei — bk, So hi +hY. 
j=l j=l 


7.13.2 UNREPLICATED TWO-FACTOR ANOVA 


1. Suppose we have a sample of observations y;; indexed by two factors 1 = 
1,2,...,mandj7 =1,2,...,n. 
2. Unreplicated two-factor model: 
(a) The unreplicated two-factor ANOVA assumes that the 27 ‘h observation is 
of the form Yj = + By + 775 + €4;. 
(b) yu is the overall mean, (3; is the it” differential effect of factor one, Tj is 
the 7 differential effect of factor two, and 


8 =) 3 = 0. 
i=1 j=l 


(c) For? = 1,2,...,m andj = 1,2,...,n, the random variables e;; are 
independent and normally distributed with mean zero and variance o?. 


(d) Total number of observations is mn. 
3. Point estimates of means: 
(a) Total sample mean 9 ie vis 
y 


(b) 7" factor-one sample mean i = Fy Luja1 Vis 


(c) j" factor-two sample mean G5 = 2 
4. Sums of squares: 
(a) Factor-one sum of squares SS, =n Ge - gD’. 
(b) Factor-two sum of squares SS. =m Li Gj - 9)’. 
: m n ~ ~ ay 2 
(c) Residual sum of squares SS; = Oy1 et (yg — Yi. —Y-5 +9) - 
(d) Total sum of squares Total SS = D0 Ey (yay — 9)’. 


(e) Partition of total sum of squares Total SS = SS; + SS2 + SS;. 


5. Degrees of freedom: 


(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Residual, (m — 1)(n — 1). 
(d) Total, mn — 1. 


6. Mean squares: 
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(a) Obtained by dividing sums of squares by their respective degrees of 











freedom. 
(b) Factor-one mean square MS; = a 
(c) Factor-two mean square MS2 = ae 
F = SS; 
(d) Residual mean square MS, = Tmatynaty* 
7. Test of the null hypothesis 6; = 62 =--- = Bm = 0 (no factor-one effects) 





against the alternative hypothesis 3; 4 0 for some 2: 


(a) Determine the critical value F, such that F' (Fj) = 1 — a, where F '(-) 
is the cumulative distribution function for the F’-distribution with m — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates 7 and y;. for i = 1,2,...,m. 

(c) Compute the sums of squares SS; and SS,. 

(d) Compute the mean squares MS, and MS,. 

(e) Compute the test statistic F’ = a. 

(f) If F > Fy, then reject the hypothesis. 

If F < FQ, then do not reject the hypothesis. 











8. Test of the null hypothesis 7; T2 ree Tr 0 (no factor-two effects) 
against the alternative hypothesis 7; 4 0 for some j: 


(a) Determine the critical value F, such that F'(F.,) = 1 — a, where F (-) 
is the cumulative distribution function for the F’-distribution with n — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates y and 7.; for 7 = 1,2,...,n 

(c) Compute the sums of squares SSz and SS,. 

(d) Compute the mean squares MS2 and MS,. 

(e) Compute the test statistic F’ = i. 

(f) If F > Fy, then reject the hypothesis. If F < Fy, then do not reject the 
hypothesis. 

(g) The above computations are often organized into an ANOVA table: 


mm 


Factor one 
Factor two 
Residual 


Peat oat SS ae 


9. Confidence interval for contrast in the factor-one means, defined by C = 
C101 + C282 +--++CmOm, where cy + cg +++: +m = 0: 
(a) Determine the critical value F, such that F' (Fj) = 1 — a, where F'(-) 
is the cumulative distribution function for the F’-distribution with m — 1 
and (m — 1)(n — 1) degrees of freedom. 
(b) Compute the point estimates ¥;. fori = 1,2,...,m 
(c) Compute the residual mean square MS,. 


(d) Compute k = ,/ FMS, (2#=! 7", c?). 


n 
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(e) The 100(1 — a) percent confidence interval for the contrast C’ is 
oper Ci. — By DOI, cai. + ki]. 

10. Confidence interval for contrast in the factor-two means, defined by C = 
cit + C272 + +++ + CnTm, Where ci + C2 +++: + Cn = 0: 

(a) Determine the critical value FY, such that F' (F,) = 1 — a, where F'(-) 
is the cumulative distribution function for the F’-distribution with n — 1 
and (m — 1)(n — 1) degrees of freedom. 

(b) Compute the point estimates ¥.; for 7 = 1,2,...,n. 

(c) Compute the residual mean square MS,. 

(d) Compute k = ,/ F,MS, (= an a) 

(e) The 100(1 — a) percent confidence interval for the contrast C’ is 
poe Cg = hy ai Gg k| 


7.13.3 REPLICATED TWO-FACTOR ANOVA 


1. Suppose we have a sample of observations y;;, indexed by two factors 1 = 
1,2,...,mandj7 = 1,2,...,n. Moreover, there are p observations per factor 
pair (2, 7), indexed by k = 1,2,...,p. 

2. Replicated two-factor model: 

(a) The replicated two-factor ANOVA assumes that the ijk" observation is 
of the form Yigk = U+ Bet Tj + Vig + Cagk- 

(b) yu is the overall mean, (3; is the i differential effect of factor one, Tj is 
the 7 differential effect of factor two, and 


a = 9 =0. 
4=1 j=l 


(c) Fort = 1,2,...,mandj =1,2,...,n, yj is the ij" interaction effect 
of factors one and two. 

(d) For 2 = 1,2,...,m, 7 = 1,2,...,n, andk = 1,2,...,p, the random 
variables e;;;, are independent and normally distributed with mean zero 
and variance o?. 


(e) Total number of observations is mnp. 


3. Point estimates of means: 


(a) Total sample mean y= aap et 2a pe Ua 
(b) i factor-one sample mean i. = a a Liat Bae 

(c) j" factor-two sample mean yy = a yi ee 

(d) ij" interaction mean Vij = “ Dok=1 Yisk- 


4. Sums of squares: 
(a) Factor-one sum of squares SS; =npl™, (G.. — 9). 
(b) Factor-two sum of squares SS2 = mp 07-1 Gy. — 9)’. 


618 CHAPTER 7. PROBABILITY AND STATISTICS 


i m n ~ ~\2 
(c) Interaction sum of squares SSi2 = pa Veja (Vij — Y)- 
(d) Residual sum of squares 
m n ~ ~ ~\2 
SS; = dint payee pat Sue He OO) 
(e) Total sum of squares Total SS = yn ofa Dogar (Yige — 9)’. 
(f) Partition of total sum of squares Total SS = SS; + SS2 + SSi2 + SS,. 


5. Degrees of freedom: 


(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Interaction, (m — 1)(n — 1). 
(d) Residual, mn(p — 1). 

(e) Total, mnp — 1. 


6. Mean squares: 


(a) Obtained by dividing sums of squares by their respective degrees of 











freedom. 
(b) Factor-one mean square MS; = SAL. 
(c) Factor-two mean square MS2 = S82, 
(d) Interaction mean square MSi2 = CES Cesel 
(e) Residual mean square MS, = aT 
7. Test of the null hypothesis 8; = 82 =--- = By, = 0 (no factor-one effects) 


against the alternative hypothesis 3; 4 0 for some 2: 


(a) Determine the critical value F, such that F' (Ff) = 1 — a, where F'(-) 
is the cumulative distribution function for the F’-distribution with m — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates 7 and %;.. for? = 1,2,...,m. 

(c) Compute the sums of squares SS; and SS;,. 

(d) Compute the mean squares MS, and MS,. 

(e) Compute the test statistic F’ = ae : 

(f) If fF > Fa, then reject the hypothesis. 

If F' < Fo, then do not reject the hypothesis. 











8. Test of the null hypothesis 7; T2 +++ = T, = 0 (no factor-two effects) 
against the alternative hypothesis 7; 4 0 for some : 


(a) Determine the critical value F, such that F'(F,) = 1 — a, where F (-) 
is the cumulative distribution function for the F’-distribution with n — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates 7 and 7.;. for 7 = 1,2,...,n. 

(c) Compute the sums of squares SSz and SS,. 

(d) Compute the mean squares MS2 and MS,. 

(e) Compute the test statistic F’ = ve : 

(f) If fF > Fg, then reject the hypothesis. 

If F < Fy, then do not reject the hypothesis. 
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9. Test of the null hypothesis 7;; = 0 for? = 1,2,...,mandj = 1,2,...,n (no 
factor-one effects) against the alternative hypothesis y;; 4 0 for some i and j: 


(a) Determine the critical value F, such that F (F,) = 1 — a, where F'(-) 
is the cumulative distribution function for the F’-distribution with (m — 
1)(n — 1) and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates ¥, Yi... .j., and Yj. for? = 1,2,..., mand 
a Oe err Le 

(c) Compute the sums of squares SS12 and SS,. 

(d) Compute the mean squares MSj2 and MS,. 

(e) Compute the test statistic F = ae. 

(f) If f > FQ, then reject the hypothesis. 

If F' < F,, then do not reject the hypothesis. 
(g) The above computations are often organized into an ANOVA table: 


Factor one F = MS, /MS, 
Factor two F = MS2/MS, 


Interaction F = MSi2/MS, 
Residual 


Tol [Toul SS[—mnp—1 [|__| 





10. Confidence interval for contrast in the factor-one means, defined by C = 
C101 + C232 = a CmPBm; where c, + Cg +--+: +Cm = 0: 


(a) Determine the critical value F, such that F (F,) = 1 — a, where F '(-) 
is the cumulative distribution function for the F’-distribution with m — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates 7;.. fori = 1,2,...,m. 

(c) Compute the residual mean square MS,. 





(d) Compute k = \/ Fas, (21 is a 


np i=1 “i 
(e) The 100(1 — a) percent confidence interval for the contrast C' is 
eatin = By Ye Ce Bs 


11. Confidence interval for contrast in the factor-two means, defined by C = 
CiTy + C2T2 + +++ + En Tp, Where cj + cg +--+: +e, = 0: 
(a) Determine the critical value F, such that F'(F.,) = 1 — a, where F (-) 
is the cumulative distribution function for the F’-distribution with n — 1 
and mn(p — 1) degrees of freedom. 
(b) Compute the point estimates 7.;. for 7 = 1,2,...,n. 
(c) Compute the residual mean square MS,. 
(d) Compute k = ,/F,MS, (4 = oe 
(e) The 100(1 — a) percent confidence interval for the contrast C' is 


ee C195 — B,D CF ge + k| ; 
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7.14 SAMPLE SIZE 


7.14.1. CONFIDENCE INTERVALS 


To construct a confidence interval of specified width, a priori parameter estimates 
and a bound on the error of estimation may be used to determine necessary sample 
sizes. For a 100(1 — a)% confidence interval, let Z = error of estimation (half 
the width of the confidence interval). The following table presents some common 
sample size calculations. 





EXAMPLE = An experiment will estimate the probability of a success, p, in a binomial 
distribution. How large a sample is needed to estimate this proportion to within 5% 
with 99% confidence? That is, what value of n satisfies Prob (|p — p| < 0.05) > 0.99. 


Since no a priori estimate of p is available, use p = 0.5. The bound on the error 
of estimation is # = .05 with 1 — a = .99. Using the table 
2 
2.005 * Pd (2.5758) (5) (.5) 
=o = CS : TA4.1 
n 7 052 663.5 ( ) 
A sample size of at least 664 should be used. This is a conservative sample size since 
no a priori estimate of p was available. If it was known that p was less than 0.3, then 
using this value gives 
2 b08 “Pq (2.5758) (.3)(.7) 


and a sample size of only 558 is needed. 
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7.14.2. BERNOULLI VARIABLES 


For a Bernoulli random variable with probability of success pg, sometimes it is 
necessary to know how many trials are required to confirm that pp > pr for a given 
threshold value pr at a significance level of a. 


Define the hypotheses: 
e Ho: pp <pr (note: expect more failures) 
e Ha: pp >pr (note: expect fewer failures) 


The probability of N Bernoulli trials with probability of success pz having 


1. exactly F failures is pdf(F'; N, pp) = Clee Fa —pp)*. 
2. F or fewer failures is cdf(F'; N, pp) = fH), F pdf(f; NV, pz). 


Recall that a = Prob (reject Ho | Ho is true). The probability of having exactly 0 
failures is cdf(0;N,pe) = pdf(0;N,ps) = p}}. This will be less than a when, 


using pp < pr when Ho is true, N > No = oe Hence, if N > No sample 
values of the Bernoulli random variable are obtained, and no failures occur, then Ho 
is rejected at a significance level of a. 

If there is a failure within the No trials, then (if the goal is to reject Ho) 
more sample values must be obtained. Define N; to be the least integer so that 
cdf(1;. Ni,pr) < a. If N > N, sample values of the Bernoulli random variable 
are obtained, and no more than | failure occurs, then Ho is rejected at a significance 
level of a. 

Likewise if N > No (with cdf(2; No, pr) < a) sample values of the Bernoulli 
random variable are obtained, and no more than 2 failures occur, then Ho is rejected 
at a significance level of a. The value N3 is defined analogously. 








| a= 10% | TH 
| p_|| No| Ni] No] Ns l] No] Ni| No] Ns |] No] Ni] No| Ns | 
0.90 |] 22] 38] 52] 65] 29] 46] oi] Fol] 44] 64] 81] 97 | 
}0.91 |] 25] 42] 58] 73] 32] 51] 68] 84 i] 49] 71] 91] 109 | 


oss 32] 55] 7s] 94] 2] 66[ 88] 10 
rose | 38[ 64] 88 [TIO | 49] 78 [103 | 127, 
153 


Poss [fas [77] 10s p1s2 | 3e] 93124 | 153] 90, 
0.96 | 





[0.99 |] 230 [388 [531 [667 |] 299 [473 [ 628 [773 [| 459 | 662 [838 
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7.14.3 OBSERVATIONS FOR VARIANCE COMPARISON 


Suppose x1, %2,...,2n+1 is a random sample from a population with variance o7. 


The sample variance, s?, has n degrees of freedom and may be used to test the hy- 


pothesis that the population variance is 02. Let R be the ratio of the variances of 


and a7. The table below shows the value of R for which a chi-square test, with 
significance level a, will not be able to detect the difference in the variances with 
probability 6. Note that when R is far from one, few samples are needed to distin- 


guish of from o7, while for R near one many samples are needed. 


EXAMPLE - Zesting for an increase in variance. Let a = 0.05, 8 = 0.01, and 
R = 4. Using the table below with these values, the value R = 4 occurs between the 
rows corresponding ton = 15 and n = 20. Using rough interpolation, this indicates 
that the variance estimate should be based on 19 degrees of freedom. 


EXAMPLE - festing for a decrease in variance. Let a = 0.05, 8 = 0.01, and R = 
0.33. Using the table below with a’ = 6 = 0.01, 8’ = a= 0.05 and R’ = 1/R=3, 
the value R’ = 3 occurs between the rows corresponding ton = 24 and n = 30. 
Using rough interpolation, this indicates that the variance estimate should be based on 
26 degrees of freedom. 


B=0.01 6=0.05 6=0.1 B=0.5)6=0.01 6=0.05 B=0.1 B=0.5 
1687.4 420.18 976.94 
89.781 43.709 58.404 
32.244 19.414 22.211 
18.681 12.483 13.349 
13.170 9.369 9.665 


10.280 = 7.627 7.699 
8.524 6.521 6.490 
7.352 5.757 5.675 
6.516 5.198 5.088 








Es 








CAND NKPWNKe 


5.890 4.770 4.646 


4.211 = 3.578 3.442 
3.462 3.019 2.895 
3.033 2.690 2.577 
2.752 2.471 2.367 
2.403 2.192 2.103 
2.191 2.021 1.942 


1.898 1.779 1.716 
1.743 1.649 1.596 
1.575 1.506 1.464 
1.000 = 1.000 1.000 
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7.15 CONTINGENCY TABLES 


The general J x J contingency table has the form: 


Treatment 1 Treatment | Treatment J | Totals 





Sample 1 nN. 
Sample 2 no. 
Sample I ie 
Totals n1 no = n 7 | on 


where n;,. = 4 Npj and n.~, = ae nip. For complete independence the prob- 
ability of any specific row and column totals {n.,, x. } is 
(Tj ni.!) fn 5!) 


Prob (mi1,-+-, P27 | M1.5+--)".3) = ae (7.15.1) 
+ A; LG ig: 


Let é;; be the estimated expected count in the (7, 7)" cell: 


— (i row total) (j column total) _ Nj (7.15.2) 
grand total n 


The test statistic is 


ie 9 (observed — estimated expected)? 7 yp rata? nij — : éi3)” (7.15.3) 
€ij 


estimated expected 


all cells i=1 g=1 


Under the null hypothesis \ is approximately chi-square distributed with (J—1)(J— 
1) degrees of freedom. The approximation is satisfactory if €;; > 5 for all i and 7. 


7.15.1. SIGNIFICANCE TEST IN 2 x 2 CONTINGENCY TABLES 


A 2 x 2 contingency table is a special case that occurs often. Suppose n elements 
are simultaneously classified as having either property | or 2 and as having property 
Tor II. The 2 x 2 contingency table may be written as: 





Totals |r n-—r n 


If the marginal totals (r, A, and B) are fixed, the probability of a given configuration 
may be written as 
(a A! BIrl(n—r)! 


f(a|r, A,B) = “Ts = qlalsl(A— al (Bb! (7.15.4) 
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The table on page 625 can be used to conduct a hypothesis test concerning the differ- 
ence between observed and expected frequencies in a 2 x 2 contingency table. Given 
values of a, A, and B, the table entries show the largest value of b (in bold type, with 
b < a) for which there is a significant difference between a/A and b/B). Critical 
values of b (probability levels) are presented for a = 0.05, 0.025, 0.01, and 0.005. 
The tables also satisfy the following conditions: 


hig 
pe 


Categories | and 2 are defined so that A > B. 


a b 
2 ee > dA. 
72 Bas 2 ba 


3. If b is less than or equal to the integer in bold type, then a/A is significantly 


greater than b/ B (for a one-tailed test) at the probability level (a) indicated by 
the column heading. For a two-tailed test, the significance level is 2a. 

A dash in the body of the table indicates no 2 x 2 table may show a significant 
effect at that probability level and combination of a, A, and B. 

For a given r, the probability b is less than the integer in bold type is shown in 
small type following an entry. 


Note that if A and B are large, this test may be approximated by a two-sample Z test 
of proportions. 


EXAMPLE In order to compare the probability of a success in two populations, the fol- 


lowing 2 x 2 contingency table was obtained. 


Success Failure || Totals 


Sample from population 1 9 
Sample from population 2 6 
Totals 15 





Is there any evidence to suggest the two population proportions are different? Use 
a= .05. 


In this 2 x 2 contingency table, a = 7, A = 9, and B = 6. For a = 0.05 the table 
entry is 1.034. 
The critical value for 6 is 1. If b < 1 then the null hypothesis Ho: p1 = pa is rejected. 
Conclusion: The value of the test statistic does not lie in the rejection region, b = 3. 
There is no evidence to suggest the population proportions are different. 
Note there are six 2 x 2 tables with the same marginal totals as the table in this example 
(that is, A = 9, B = 6, and r = 10): 

9 0 8 1 7 2 6 3 5.4 4 5 

1 5 2 4 aes) 4 2 5 1 6 0 
Assuming independence, the probability of obtaining each of these six tables (using 
Equation (7.15.4), rounded) is {.002, .045, .24, .42, .25, .042}. That is, the first con- 
figuration is the least likely, and the fourth configuration is the most likely. 


7.15. CONTINGENCY TABLES 


Contingency tables: 2 x 2 


oe 


O05]O 


oe 


OOS 


A=8B=5 01 016 
ees 
B=4 |, .018] 1.018 | 0.002] 0.002 
0.010} 0.010 
0.030 


B= -- 0.006] 0.006 [0.006 
7}0.024| 0.024) — 
= 0 


1.008 Ao 0.001 
= 
015] 1.015 ]0.002] 0.002 
013] 0.013 
Sooo 
033 
coors 


005 [0.005 








1.010]0.001] 0.001 
0.008 ]0.008 B=5 
1.024 0.003] 0.003 
0.015 
B=4 


0.008] 0 .008 | 0.008 
ae 


moose —[—} 








7035 1.007 |1.007] 0.001 
1.031] 0.005 |0.005] 0.005 
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7.16 ACCEPTANCE SAMPLING 


The USA’s Department of Defense uses the sampling plans described in MIL-STD- 
1916 (Military Standard 1916); this has replaced the older MIL-STD-105 D. In this 
standard there are three kinds of sampling plans, seven verification levels (VL), five 
code letters (CL), and three types of inspection. First, the following are determined: 


1. Determine the appropriate sampling type (attributes, variables, or continuous). 


(a) Attributes sampling has a sample size. 

(b) Variables sampling has a sample size as well as “k” and “F” criteria. 

(c) Continuous sampling has “clearance number” (7) and “frequency” (f) 
criteria. 


2. From the contract determine the specified verification level (VL). 

3. From the lot size determine the code letter (CL). 

4. From the production history determine the appropriate type of inspection (nor- 
mal, tightened, or reduced) 


Then the sampling process to be used can be obtained from MIL-STD-1916. 

1. When the lot size is less than or equal to the sample size, 100% inspection is 
required. 

2. For each verification level (VL) the sampling size for the normal type of in- 
spection is obtained from a column and row in the appropriate table. Usually, 
the sample size for the tightened/relaxed type (using more/fewer samples) is 
obtained from the same row, but from the column to the left/right. 

MIL-STD-1916 contains a description of when to switch the type of inspection. Ap- 
proximately, when performing lot sampling: 

e of the normal type, if 10 consecutive lots pass then the type becomes reduced. 

e of the normal type, if 2 lots fail in the last 5 then the type becomes tightened. 

of the reduced type, if one lot fails then the type becomes normal. 
of the tightened type, if 5 consecutive lots pass then the type becomes normal. 


Code letters (CL) used in sampling tables 


Lot siz 
var [VE pv [av | | 


1633-3072 | A TA [By 
3,073-5,440 | A |B | 
ea 


Dp 
$30,721 
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e Attributes Sampling 
Code letter Verification Levels (VL) 
| TT vie] vt TV TV | | ae] oR 
sample size 


28 


PB [4096 [7536 | 640 [256] 96 [40 [16] 6 [3 
Pc __]3,120 [2.048 [768320 | 28 | 48 [208 [3 
PD __ [6.144 [2.560 | 1,004 [384 | 160 | 64 [24 [10] 4 | 
PE [8.192 | 3.072 | 1.280 | 512 | 192 [80 [32 [2 |S 

e Variables sampling 
Code letter Verification Levels (VL) 

| T [vi} vit v {iv [mt ot i R | 
[A Bw ee [eT ep Ts? 
a 
[> [efor far fe fa [ef fs] 3 | 
Pe sper fe~eys [spss 
PY k values (one- or two-sided) 
PB 358] 332 [3.07 [2.79 [2.46 | 21a [77133 | 120, 
PC 364 [3.40 [3.12 | 2.86 [2.56 [221 [186 [745 | 120, 
PD [3.69 [3.46 [3.21 [297 [2.63 | 2.32 | 193 | 156 | 120 
[376 [3.51 [3.27 [3.00 [2.69] 2.40 [2.05 [1.64 | 12 | 
values ewosided) 

TB 

| BT 

| 
| DT 
| OE 





e Continuous sampling 
Code letter Verification Levels (VL) 


[rT pwpw[vy[w[m[a[1yR 


ne phase: clearance numbers (7) 


3867 





500 
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7.17 PROBABILITY TABLES 


7.17.1. CRITICAL VALUES 


1. The critical value z, satisfies ®(z,) = 1 — a (where, as usual, ®(z) is the 
distribution function for the standard normal). See Figure 7.3. 


ce = L ot)? ge — ; (1 ie (=)) @171) 


1.282 1.645 1.960 2.326 2.576 3.090 


®(r) |0.90 0.95 0.975 0.99 0.995 0.999 
2[1— ®(2)] |0.20 0.10 0.05 0.02 0.01 0.002 


[a «(3.09 3.72 426 475 5.20 5.61 6.00 6.36 


1—®(z) | to-* 10“ t0-° 10-* 10-’ 10° 10°? 10-*° 


For large values of x: 


—a?/2 4 1 —a?/2 4 
e e€ 
—— | -- =) <1- (2) < | —[- (7.17.2) 
V2n € x) Mi V20 (=) 
2. The critical value t,, satisfies F(t.) = 1 — a where F‘(-) is the distribution 
function for the ¢-distribution (for a specified number of degrees of freedom). 
3. The critical value \2 satisfies F(y2) = 1 — a where F‘(-) is the distribution 
function for the .?-distribution (for a specified number of degrees of freedom). 


4. The critical value F(, satisfies F(F,) = 1 — a where F‘(-) is the distribution 
function for the F’-distribution (for a specified number of degrees of freedom). 








FIGURE 7.3 
The shaded region is defined by X > Za and has area a (here X is N(0,1)). 





Za 
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7.17.2. TABLE OF THE NORMAL DISTRIBUTION 


For a standard normal random variable (see Figure 7.4): 


Proportion of 
the total area 


Limits 


Remaining 


area 


[b—o 
pb — 1.650 
pb — 1.960 


pb— 20 
pb — 2.580 
p— 30 
pb — 3.090 
pb — 3.290 


FIGURE 7.4 





68.27 
90 
95 

95.45 

99.0 

99.73 

99.8 

99.9 


Illustration of o and 20 regions of a normal distribution. 


0.50399 
0.51197 
0.51994 
0.52790 
0.53586 
0.54380 
0.55172 
0.55962 
0.56749 
0.57534 





0.49601 
0.48803 
0.48006 
0.47210 
0.46414 
0.45621 
0.44828 
0.44038 
0.43250 
0.42466 


0.39892 
0.39876 
0.39844 
0.39797 
0.39733 
0.39654 
0.39559 
0.39448 
0.39322 
0.39181 


0.50798 
0.51595 
0.52392 
0.53188 
0.53983 
0.54776 
0.55567 
0.56356 
0.57142 
0.57926 





0.49202 
0.48405 
0.47608 
0.46812 
0.46017 
0.45224 
0.44433 
0.43644 
0.42858 
0.42074 





0.39886 
0.39862 
0.39822 
0.39767 
0.39695 
0.39608 
0.39505 
0.39387 
0.39253 
0.39104 
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px | (aw) 1 F(@) | fe) te FP) F@) | f@)_ 
0.58317 | 0.41683 | 0.39024 0.58706 | 0.41294 | 0.38940 
0.59095 | 0.40905 | 0.38853 0.59484 | 0.40516 | 0.38762 
0.59871 | 0.40129 | 0.38667 || 0.26 | 0.60257 | 0.39743 | 0.38568 
0.60642 | 0.39358 | 0.38466 || 0.28 | 0.61026 | 0.38974 | 0.38361 
0.61409 | 0.38591 | 0.38251 || 0.30 | 0.61791 | 0.38209 | 0.38139 
0.62172 | 0.37828 | 0.38023 || 0.32 | 0.62552 | 0.37448 | 0.37903 
0.62930 | 0.37070 | 0.37780 0.63307 | 0.36693 | 0.37654 
0.63683 | 0.36317 | 0.37524 0.64058 | 0.35942 | 0.37391 
0.64431 | 0.35569 | 0.37255 0.64803 | 0.35197 | 0.37115 
0.65173 | 0.34827 | 0.36973 0.65542 | 0.34458 | 0.36827 


0.65910 | 0.34090 | 0.36678 0.66276 | 0.33724 | 0.36526 
0.66640 | 0.33360 | 0.36371 0.67003 | 0.32997 | 0.36213 
0.67365 | 0.32636 | 0.36053 0.67724 | 0.32276 | 0.35889 
0.68082 | 0.31918 | 0.35723 0.68439 | 0.31561 | 0.35553 
0.68793 | 0.31207 | 0.35381 || 0. 0.69146 | 0.30854 | 0.35207 
0.69497 | 0.30503 | 0.35029 || 0. 0.69847 | 0.30153 | 0.34849 
0.70194 | 0.29806 | 0.34667 || 0. 0.70540 | 0.29460 | 0.34482 
0.70884 | 0.29116 | 0.34294 || 0. 0.71226 | 0.28774 | 0.34105 
0.71566 | 0.28434 | 0.33912 || 0. 0.71904 | 0.28096 | 0.33718 
0.72240 | 0.27759 | 0.33521 0.72575 | 0.27425 | 0.33322 


0.72907 | 0.27093 | 0.33121 0.73237 | 0.26763 | 0.32918 
0.73565 | 0.26435 | 0.32713 0.73891 | 0.26109 | 0.32506 
0.74215 | 0.25785 | 0.32297 0.74537 | 0.25463 | 0.32086 
0.74857 | 0.25143 | 0.31874 0.75175 | 0.24825 | 0.31659 
0.75490 | 0.24510 | 0.31443 0.75804 | 0.24196 | 0.31225 
0.76115 | 0.23885 | 0.31006 0.76424 | 0.23576 | 0.30785 
0.76731 | 0.23270 | 0.30563 0.77035 | 0.22965 | 0.30339 
0.77337 | 0.22663 | 0.30114 || 0. 0.77637 | 0.22363 | 0.29887 
0.77935 | 0.22065 | 0.29659 || 0. 0.78231 | 0.21769 | 0.29430 
0.78524 | 0.21476 | 0.29200 0.78814 | 0.21185 | 0.28969 


0.79103 | 0.20897 | 0.28737 0.79389 | 0.20611 | 0.28504 
0.79673 | 0.20327 | 0.28269 || 0. 0.79955 | 0.20045 | 0.28034 
0.80234 | 0.19766 | 0.27798 || 0. 0.80510 | 0.19490 | 0.27562 
0.80785 | 0.19215 | 0.27324 || 0. 0.81057 | 0.18943 | 0.27086 
0.81327 | 0.18673 | 0.26848 || 0. 0.81594 | 0.18406 | 0.26609 
0.81859 | 0.18141 | 0.26369 || 0. 0.82121 | 0.17879 | 0.26129 
0.82381 | 0.17619 | 0.25888 0.82639 | 0.17361 | 0.25647 
0.82894 | 0.17106 | 0.25406 0.83147 | 0.16853 | 0.25164 
0.83398 | 0.16602 | 0.24923 0.83646 | 0.16354 | 0.24681 
0.83891 | 0.16109 | 0.24439 0.84135 | 0.15865 | 0.24197 
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7.17.3. PERCENTAGE POINTS, STUDENT’S t-DISTRIBUTION 


For a given value of n and a this table gives the value of ta,, such that 


tam T((n + 1)/2) an ae 
- “Jnal (n/2) (1 + -) dx =1-a (7.17.3) 


The ¢-distribution is symmetrical, so that F'(—t) = 1 — F(t). 


EXAMPLE The table gives ta=o.60,.n=2 = 0.325. 
Hence, when n = 2, F'(0.325) = 0.4. 


F (ta,n) = 
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SQUARE DISTRIBUTION 


CHI- 


7.17.4 PERCENTAGE POINTS 


For a given value of n this table gives the value of ? such that 


17.4) 


[fad 
ww 
8 
a) 
“ 
~~ [oa 
BIN 
lS 
er fe 
= 1G 
N IN 
I b> 
EZ |N 
8 
a 
x 
2 
| 
— 
N 
= 
& 


is a specified number. 


SE 
SCC 
C81 
ov 
sel 
Vel 
Cl 
OTT 
601 
Vol 
6¢°6 
L9°8 
96'L 
9CL 
Lg‘9 
68'S 
eos 
LoV 
vO'' 
tos 
elt 
LVT 
pol 
STI 
ITL‘0 
cse'0 
coro 
£6£00'0 


VCE 
9°0¢ 
891 
Tel 
Vl 
Lit 
OTT 
cOl 
6S°6 
168 
£78 
9OL 
169 
9e9 
£9'S 
10's 
Ory 
CBE 
Sve 
OL? 
81 
691 
vel 
Te8°0 
b8r'0 
9170 
90S0°0 
1786000'0 


L'6C 
C81 
O's 
Il 
6 Ol 
TOL 
vS'6 
06'8 
978 
OL 
IO'L 
Iv9 
18°¢ 
ecg 
99° 
IT 
Lv€ 
sOve 
99'S 
60°C 
co" 
vel 
cL8'0 
vss'0 
L670 
SILO 
10c0°0 
TZS1000'0 


0'8¢ 
CLI 
sel 
COI 
68°6 
976 
798 
£0'8 
evl 
89 
9c°9 
OL’S 
vis 
09'7 
LOY 
LS" 
LO'e 
09°C 
OT? 
eL'l 
vel 
686°0 
9L9'0 
cIr'0 
L070 
LILO'0 
00100 
£6€0000'0 
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DISTRIBUTION 


Given n and m this gives the value of f such that 


F 


7.17.5 PERCENTAGE POINTS 


iii il + max)~("™+")/2 dr = 0.8. 
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Given n and m this gives the value of f such that 


mmr 2nr/2gm/2-l(n + ma)~(m+n)/2 dx = 0.95. 
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Given n and m this gives the value of f such that 


mim 2nrl2gm/2—-l on 4 mg)—Or+n)/2 de = 0,975. 
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Given n and m this gives the value of f such that 


m™annl2gm/2-1 in 4 mg)—(mtn)/2 de — 0,99, 
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Given n and m this gives the value of f such that 


m™/2nrl2gm/2—-ln 4 mg)—(r+n)/2 de — 0,995. 
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Given n and m this gives the value of f such that 


m™/2nrl2gm/2—-l in 4 mg)—(r+n)/2 de — 0,999. 
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7.17.6 CUMULATIVE TERMS, BINOMIAL DISTRIBUTION 


B(n,2;p) => (j,)e*a =n", 
k=0 
Note that B(n,x;p) = B(n,n — 2;1-—p). 

If p is the probability of success, then B(n, x; p) is the probability of x or fewer 
successes in n independent trials. For example, if a biased coin has a probability 
p = 0.4 of being a head, and the coin is independently flipped 5 times, then there is 
a 68% chance that there will be 2 or fewer heads (since B(5, 2; 0.4) = 0.6826). 


a oe 
[| oro a0 aa 
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7.17.7 CUMULATIVE TERMS, POISSON DISTRIBUTION 
\M 
F(a#;X) = » ee 


k=0 
If A is the rate of Poisson arrivals, then F(x; ) is the probability of 2 or fewer 
arrivals occurring in a unit of time. For example, if customers arrive at the rate of 
X = 0.5 customers per hour, then the probability of having no customers in any 
specified hour is 0.61 (the probability of one or fewer customers is 0.91). 
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1.000 


0.999 | 0.999 | 1.000 
0.997 | 0.998 | 0.999 | 1.000 





7.17. PROBABILITY TABLES 643 


7.17.8 CRITICAL VALUES, KOLMOGOROV-SMIRNOV TEST 


One-sided test = 0.90 | 0.95 | 0.975 | 0.99 | 0.995 
Two-sided test he = 0.80] 0.90 | 0.95 | 0.98 | 0.99 





Gana L. 1.07 122 22 iE 1.36 is 1.92 iF 1.63 
forn > 40: 


7.17.9 CRITICAL VALUES, TWO SAMPLE 
KOLMOGOROV-SMIRNOV TEST 


The value of D = max |F},, (a) — F,,(x)| shown below is so large that the hypoth- 
esis Ho, the two distributions are the same, is to be rejected at the indicated level of 
significance. Here, n; and ng are assumed to be large. 


Level of significance | Value of D 


ie Pe, nirns2 
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fi 36 a +rn2 
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7.17.10 CRITICAL VALUES, SPEARMAN’S RANK 
CORRELATION 


Spearman’s coefficient of rank correlation, p;, measures the correspondence between 
two rankings. Let d; be the difference between the ranks of the i" pair of a set of n 
pairs of elements. Then Spearman’s rho is defined as 


6 ie G vigil t _ 6S, 


=1- 
s 
p nm—n ne—n 


where S, = >>;"_, d?. The table below gives critical values for S;. when there is 
complete independence. 


Pe [p= OWT p = 095 [p= OT p= 00 
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8.1 BASIC NUMERICAL ANALYSIS 


8.1.1 APPROXIMATIONS AND ERRORS 


Numerical methods involve finding approximate solutions to mathematical prob- 
lems. Errors of approximation can result from two sources: error inherent in the 
method or formula used and round-off error. Round-off error results when a calcu- 
lator or computer is used to perform real-number calculations with a finite number 
of significant digits. All but the first specified number of digits are either chopped or 
rounded to that number of digits. 

If p* is an approximation to p, the absolute error is defined to be |p — p*| and 
the relative error is |p — p*|/|p|, provided that p # 0. 

Iterative techniques often generate sequences that (ideally) converge to an exact 
solution. It is sometimes desirable to describe the rate of convergence. 





Definition Suppose lim 8, = 0 and limay = a. If a positive constant K exists with 
|an —al < K|G,| for large n, then {a} is said to converge to a with a rate of 
convergence O(,,). This is read “big oh of G,,” and written a, = a+ O(G,). 


Definition Suppose {p,,} is a sequence that converges to p, with pn # p, for all n. If 


|Pn4i — Pl 


positive constants \ and a exist with lim = , then {p,} converges to p 


n—+co |Pn — p 
of order a, with asymptotic error constant X. 
In general, a higher order of convergence yields a more rapid rate of conver- 
gence. A sequence has linear convergence if ~ = 1 and quadratic convergence if 
a=2. 


8.1.1.1. Aitken’s A? method 


Definition Given {p,,}°o, the forward difference Ap», is defined by Apn = Pn4i—Pn; 
for n > 0. Higher powers A* py are defined recursively by A* pn = A(A*t Dn), for 
k > 2. In particular, A? pn = A(pn41 — pn) = pnt2 — 2Pnti + Pn. 
If a sequence {p,,} converges linearly to p and (py — p)(pn—1 — p) > 0, for 
sufficiently large n, then the new sequence {p,,} generated by Aitken’s A? method, 


(Apn)? 


Dr = Pn — 


for all n > 0, satisfies lim, ,., a 
Pn — P 


= 0. 





8.1.1.2 Richardson’s extrapolation 


Improved accuracy can be achieved by combining extrapolation with a low-order 
formula. Suppose the unknown value M is approximated by a formula N(h) for 
which 





M = N(h)+ Kih4+ Koh? + K3h3 +... (8.1.2) 
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for some unspecified constants Ky, K2,K3,.... To apply extrapolation, set 
N,(h) = N(h), and generate new approximations N;(h) by 
h\ . Nj-1 (3) — Nj-i(h) 
N,(h) = Nj-1 (5) + —— si, —~CS~S (8.1.3) 


Then M = Nj(h) + O(h’). A table of the following form is generated, one row at 
a time: 

Ni (h) 

Ni (4/2) Na(h) 

Ni (/4) No (h/2)  Na(h) 

Ni (8) No(s) Na(h/2) Na(h). 


Extrapolation can be applied whenever the truncation error for a formula has the 
form yan Kjh% + O(h®™) for constants AK; and ay < ag < +--+ < Gm. In 
particular, if a; = 27, the following computation can be used: 


h N;-1(®) — Nj_i(h 
Ni = Neg (3) 4 faa) sae) (8.1.4) 


and the entries in the j" column of the table have order O(h”’). 


8.1.2 SOLUTION TO ALGEBRAIC EQUATIONS 


Iterative methods generate sequences {p,,} that converge to a solution p. 


Definition A solution p of f(x) = 0 is a zero of multiplicity m if f(x) can be written as 
f(x) = (@ — p)™q(a), for « 4 p, where limz-,, q(x) 4 0. A zero is called simple if 
m=tl1. 


8.1.2.1 Fixed-point iteration 
A fixed point p for a function g satisfies g(p) = p. Given po, generate {p,,} by 


Pnti= 9(pn) forn> 0. (8.1.5) 


If {p,} converges, then it will converge to a fixed point of g and the value p,, can 
be used as an approximation for p. The following theorem gives conditions that 
guarantee convergence. 


THEOREM 8.1.1 (Fixed-point theorem) 

Let g € Cla, b] and suppose that g(x) € [a, }] for all x in [a,b]. Suppose also that 
g’ exists on (a,b) with |g'(a)| < k < 1, forall a © (a,b). If po is any number 
in |a, b], then the sequence defined by Equation (8.1.5) converges to the (unique) 
fixed point p in [a,b]. Both of the error estimates |pp, — p| < — \po — pi| and 
\Pn — p| < k™max{po — a,b — po} hold, for alln > 1. 


The iteration sometimes converges even if the conditions are not all satisfied. 
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THEOREM 8.1.2 

Suppose g is a function that satisfies the conditions of Theorem 8.1.1 and g! is also 
continuous on (a,b). If g'(p) # 0, then for any number po in |a, b], the sequence 
generated by Equation (8.1.5) converges only linearly to the unique fixed point p in 
la, b]. 


THEOREM 8.1.3 

Let p be a solution of the equation x = g(x). Suppose that g'(p) = 0 and g" are 
continuous and bounded by a constant on an open interval I containing p. Then 
there exists a 6 > 0 such that, for po © |p — 6,p + 4], the sequence defined by 
Equation (8.1.5) converges at least quadratically to p. 


8.1.2.2 Steffensen’s method 


For a linearly convergent fixed-point iteration, convergence can be accelerated by 


applying Aitken’s A? method. This is called Steffensen’s method. Define p = po, 


compute p = g(p”) and p? = g(p””’. Set ps = Po which is computed using 


Equation (8.1.1) applied to po : po? and po. Use fixed-point iteration to compute 


pi? and ps? and then Equation (8.1.1) to find p??. Continuing, generate {ph}, 


THEOREM 8.1.4 


Suppose that x = g(x) has the solution p with |g'(p)| < 1 and g € C? in aneighbor- 
hood of p. Then there exists a 6 > 0 such that Steffensen’s method gives quadratic 
convergence for the sequence {p\} for any po € [p — 6,p + 6]. 


8.1.2.3 Newton—Raphson method (Newton’s method) 


To solve f(x) = 0, given an initial approximation po, generate {p,,} using 


Pnit = Pn — a . forn > 0. (8.1.6) 





Figure 8.1 illustrates the method geometrically. Each value p,,41 represents the 2- 
intercept of the tangent line to the graph of f (2) at the point [p,, f(pn)]- 


THEOREM 8.1.5 

Let f € C?[a, b]. If p € [a,b] is such that f(p) = 0 and f'(p) # 0, then there exists 
a6 > 0 such that Newton’s method generates a sequence {p,,} converging to p for 
any initial approximation po € [p — 6,p + 6}. 


Note: 


1. Generally the conditions of the theorem cannot be checked. Therefore one 
usually generates the sequence {p,,} and observes whether or not it converges. 

2. An obvious limitation is that the iteration terminates if f’(p,) = 0. 

3. For simple zeros of f, Theorem 8.1.5 implies that Newton’s method converges 
quadratically. Otherwise, the convergence is much slower. 
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FIGURE 8.1 


Illustration of Newton’s method.' 


yA 


Slope f (py) y = fix) 






f (P1. (Pi) 


Slope f’ (po) 





(Po; f(Po)) 





8.1.2.4 Modified Newton’s method 


Newton’s method converges only linearly if p has multiplicity larger than one. How- 
— f(x) 
— £7(@) 
formula applied to u(x) yields quadratic convergence to a root of f(a) = 0. The 
iteration simplifies to 


ever, the function u() has a simple zero at p. Hence, the Newton iteration 


Pnt1 = Pn — Fn) F (Pn) 
" " [f’ (Pn)? = f (Dn) Ff" (Dn) ’ 


8.1.2.5 Root-bracketing methods 


Suppose f(x) is continuous on [a,b] and f(a) f(b) < 0. The Intermediate Value 
Theorem guarantees a number p € (a,b) exists with f(p) = 0. A root-bracketing 
method constructs a sequence of nested intervals [a,,, b,,], each containing a solution 
of f(x) = 0. At each step, compute p,, € [a,,, b,] and proceed as follows: 


forn > 0. (8.1.7) 


If f(p,) = 0, stop the iteration and p = pp. 
Else, 


if f(an) f (pn) < 0, then set an41 = Gn, bn41 = Dn- 
Else, set @n41 = Pn; On41 = dn. 


'Rrom R. L. Burden and J. D. Faires, Numerical Analysis, 7th ed., Brooks/Cole, Pacific Grove, CA, 
2001. With permission. 
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8.1.2.6 Secant method 


To solve f(x) = 0, the secant method uses the x-intercept of the secant line passing 
through (pn, f(Pn)) and (Pn—1, f(Pn—1)). The derivative of f is not needed. Given 
Po and p,, generate the sequence with 


(Dn —_ Pn—1) 


Tosatocny | neh B18) 


Pn+1 = Pn — f (Pn) 


8.1.2.7 Bisection method 


This is a special case of the root-bracketing method. The values p,, are computed by 


bn — an an fe bn 
Pn = An + 5 = ne forn > 1. (8.1.9) 








Clearly, |pp, — p| < (b—a)/2” for n > 1. The rate of convergence is O(2~"). 
Although convergence is slow, the exact number of iterations for a specified accuracy 
€ can be determined. To guarantee that |pv — p| < e, use 


b— In(b— a) —1 
N > log, (—) = eae (8.1.10) 


8.1.2.8 False position (regula fals/) 


bn — Gn 
it bn = bn 77 aa, ny 
a CFCS) 


This root-bracketing method also converges if the initial criteria are satisfied. 


forn>1. (8.1.11) 


8.1.2.9 Horner’s method with deflation 

If Newton’s method is used to solve for roots of the polynomial P(a) = 0, then 
the polynomials P and P’ are repeatedly evaluated. Horner’s method efficiently 
evaluates a polynomial of degree n using only n multiplications and n additions. 


8.1.2.10 Horner’s algorithm 


To evaluate P(x) = anx” + an_1x"-1 +... + ao and its derivative at rp: 


INPUT: degree n, coefficients {a9, a1,.--,@n}3 Xo, 
OUTPUT: y = P(x); z = P’(2o). 
Algorithm: 


1. Set y = Gn; 2 =n. 
2. Forj=n—1,n—-2,...,1, 
sety = Toy +aj,;2=Xoz+ y. 
3. Set y = toy + ao. 
4. OUTPUT (y, z). STOP. 
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When satisfied with the approximation £, for a root x; of P, use synthetic division 
to compute Q1(x) so that P(a#) + (a — %,)Qi(«). Estimate a root of Qi (a) and 
write P(x) & (a — £1)(a@ — %2)Qo(a), and so on. Eventually, Q,—2(«) will be a 
quadratic, and the quadratic formula can be applied. This procedure, finding one root 
at a time, is called deflation. 

Note: Care must be taken since #1 is an approximation for x1. Some inaccuracy 
occurs when computing the coefficients of Q(x), etc. Although the estimate £2 of a 
root of (1 (a) can be very accurate, it may not be as accurate when estimating a root 
of P(x). 


8.1.3 INTERPOLATION 


Interpolation involves fitting a function to a set of data points (29, yo), (1, Y1), 
+5 (In; Yn). The x; are unique and the y; may be regarded as the values of some 
function f(a), that is, y; = f(a;) fori = 0,1,...,n. The following are polynomial 
interpolation methods. 


8.1.3.1 Lagrange interpolation 


The Lagrange interpolating polynomial, denoted P,, (x), is the unique polynomial of 
degree at most n for which P,,(«;,) = f(x) fork = 0,1,...,n. Itis given by 


Pa= seals) (8.1.12) 
k=0 
where {2o,..., Un} are called node points, and 


(@ = 2o)(a — a1) +++ (@ — Bea) (2 — Depi)+++ (2 — Ta) 


Lig 3 SS S650 S90 aSSaSaSSo_0—_—_—————q00 Tt 
k(x) (xy — 20)(@e — @1)+++ (Wk — TR-1)(@e — Th41) +++ (Lk — Ln) 
7 cia: rs (8.1.13) 
(Ze — Zi) 


i=0,i¢k 


THEOREM 8.1.6 (Error formula) 


If %9,@1,.--,2n are distinct numbers in {a,b| and f € C"*"{a, b], then, for each x 
in [a, b], a number €(2) in (a, b) exists with 
(n+) (E(q 
(n+ 1)! 


where P is the interpolating polynomial given in Equation (8.1.12). 


Although the Lagrange polynomial is unique, it can be expressed and evaluated 
in several ways. Equation (8.1.12) is tedious to evaluate, and including more nodes 
affects the entire expression. Neville’s method evaluates the Lagrange polynomial at 
a single point without explicitly finding the polynomial and the method adapts easily 
when new nodes are included. 


652 CHAPTER 8. SCIENTIFIC COMPUTING 


8.1.3.2 Neville’s method 


Let Pr, ,mo,...,m, denote the Lagrange polynomial using distinct nodes {%,, Um; 
..+, Xm, }. If P(x) denotes the Lagrange polynomial using nodes {29,11,..., 0%} 
and x, and x, are two distinct numbers in this set, then 


Peis (x — ©3)Po,1,....7-1,5-41,...,6(@) — (© — @4)Po)1,...i—-1,841,..., w(t) 
(x; — 23) 

8.1.3.3 Neville’s algorithm 
Generate a table of entries Q;,; for 7 > 0 and 0 < i < 3 where the terms are 
Qij = Pi-j,i—j41....,i-1,i- Calculations use Equation (8.1.3.2) for a specific value 
of x as shown: 

xo Qo = Po 

a Qio=Pr Qa = Po. 

tw Qoo=Po Qai=Pi2 Qe22= Pore 

t%3 Q30=P3 Q31=Po3 Q32 = Pi23 Q3,3 = Po1,2,3 


Note that P, = P,(x) = f(x,) and {Q;,;} represents successive estimates of f (2) 


using Lagrange polynomials. Nodes may be added until |Q;,; — Qi-1,i-1| < € as 
desired. 


8.1.3.4 Divided differences 


Some interpolation formulas involve divided differences. Given an ordered sequence 
of values, {x;}. and the corresponding function values f(zx;), the zero’ divided 
difference is f|x;] = f(a;). The first divided difference is defined by 


flzi, Vi+1] = f(xis) — (xi) = Fleiss] ~ fled) (8.1.15) 


V4 — Uy Tis Uy 


The k" divided difference is defined by 


Ff [zi, Tit+1,+++,Litk-1; 547 
_ f leita, ti42,.--, Gite] — f lei, Vi41,.--,Tith—1] 
Litk — Vy , 


(8.1.16) 


Divided differences are usually computed by forming a triangular table. 


First Second Third 
x f(a) | divided differences | divided differences | divided differences 
ro f {xo 


f (xo, £1, £2] 
f[xo, 41, £2, ©3] 
flz1, X2, 23] 
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8.1.3.5 Newton’s interpolatory divided-difference formula 


P,(2) = f[zol + © f[zo,21,-.-,2e](@ — 2) +++ (aw — &p_1). (8.1.17) 
k=1 


Labeling the nodes as {@,,%n-1,.--,2o}, a formula similar to Equation 
(8.1.17) results in Newton’s backward divided-difference formula, 


Pals) = fxn] Tv flan, tn—1](@ = Ln) 
+ fn, En—1,n—2](%¥ — Xn)(Z — Zn_-1) (8.1.18) 
+...4+f|[&n,En—-1,---,Lo|(@ — In) +++ (@ — 24). 





If the nodes are equally spaced (that is, x; — x;_1 = h), define the parameter s by 
x = x + sh. The following formulas evaluate P,, (a) at a single point: 


1. Newton’s interpolatory divided-difference formula, 
P,,(x) = Pp(xp + sh) = by @ kih* f[ao,a1,..-, €p]- (8.1.19) 
2. Newton’s forward-difference formula (Newton—Gregory), 
P,,(x) = Pp(xo + sh) = d (;) A* f (20). (8.1.20) 


3. Newton—Gregory backward formula (fits nodes x_,, to x0), 


Pa(t) = f(e0) + (2) d sea) + (°5') 2? fe-a}+ 


re “ ‘) A” f(a). (8.1.21) 


4. Newton’s backward-difference formula, 
Pa(w) = >>(-1)* i) yf (@a)s (8.1.22) 
k=0 
where 7" f(a») is the k backward difference, defined for a sequence {p,,}, 
by VPn = Pn — Pn—1 forn > 1. Higher powers are defined recursively by 
Vpn = V(V*~1pn) for k > 2. For notation, set V°pn = pn. 
5. Stirling’s formula (for equally spaced nodes x#_, ..., U1, U0, 1,---, Um), 


Pa (2) = Pamsx(2) = flo] + S2(Fle—1,20] + fleo,e1))+ 
s(s? — 1)h3 
2 

+...+87(s? — 1)(s? — 4)---(s? — (m—1)?)h?™ fla_m,..., 2m] 
s(s? — 1)---(s? — m?)hn2™*1 
2 


s*h? f[z_1, £0, 21] + CF [@=2; 81,20, 2 + Fle—-1, Bo, 11,24) 





+ CF tum aig 2 5 | FF tess 2 Bm pil )- 
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Use the entire formula if mn = 27m + 1 is odd, and omit the last term if 2 = 2m 
is even. The following table identifies the desired divided differences used in 
Stirling’s formula: 


First divided | Second divided Third divided 
£ f(x) | differences differences differences 
t-2| f[x-o] 


fleso,=1, 20] 


f|z-2, T_), Zo, 21] 


f[z-1, £0, 21] 
flz-1, ZO, Ti, Pol 
f|xo, £1, 29] 





8.1.3.6 Inverse interpolation 

Any method of interpolation which does not require the nodes to be equally spaced 
may be applied by interchanging the nodes (a values) and the function values (y 
values). 


8.1.3.7 Hermite interpolation 

Given distinct numbers {29,71,...,@n}, the Hermite interpolating polynomial for 
a function f is the unique polynomial H(a) of degree at most 2n + 1 that satisfies 
H(a;) = f(a) and H’(x;) = f’(a;) foreach i = 0,1,...,n. 

A technique and formula similar to Equation (8.1.17) can be used. For distinct 
nodes {xo0, 21, ine 5 Bn, define {z0, B1y+2ey Zon+i} by 204 = £2141 = VM fori = 
0,1,...,n. Construct a divided difference table for the ordered pairs (z;, f(zi)) 
using f’(x;) in place of f[z2;, 22:41], which would be undefined. Denote the Hermite 


polynomial by H2,,41(x). 


8.1.3.8 Hermite interpolating polynomial 
2n+1 


Honsi(2) = flzo] + >~ flzo,21)-- 2] (a — 20) +++ (@ — 2x1) 
k=1 





= f [zo] + flo, 21](x — 20) + f[0, 21, 22](@ — 20)? (8.1.23) 
=e f 20, 21522; 23] (ax = to)? (x = X1) 
+...+flzo,-..,2anti](a@ — a0)? > (@ — Sp_1)"(a — ap). 


THEOREM 8.1.7 (Error formula) 
If f € C?"*?[a, b], then 





fm (€(0)) 
(2n + 2)! 


for some &(a) € (a,b) and where x; € [a,b] for eachi = 0,1,...,n. 


f(x) = Aon4i(z) + (a — 2)?-+- (2 — ay)? (8.1.24) 
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8.1.4 DATA FITTING 
8.1.4.1 Piecewise polynomial approximation 


An interpolating polynomial has large degree and tends to oscillate greatly for large 
data sets. Piecewise polynomial approximation divides the interval into a collec- 
tion of subintervals and constructs an approximating polynomial on each subinter- 
val. Piecewise linear interpolation consists of simply joining the data points with 
line segments. This collection is continuous but not differentiable at the node points. 
Cubic spline interpolation is popular since no derivative information is needed. 


Definition Given a function f defined on [a, b] and a set of numbers a = 2 < 11 < 
... <n = b,acubic spline interpolant, S, for f is a function that satisfies 
1. Sis acubic polynomial, denoted S$, on [x;,7j;+1] for 7 = 0,1,...,n—1. 
2. Forj =0,1,...,n: S(a;) = f(a;) 
3. Forj = 0,1,...,n—2. 
© S541(xj41) = Sy(j+1) 
© Sh 41 (2541) = $5 (2541) 
© Sify (tg41) = SY (sta) 











4. One of the following sets of boundary conditions is satisfied: 


e 8” (x20) = 8" (an) =0 (free or natural boundary), 
e S'(xo) = f'(wo) and S$"(an) = f' (an) (clamped boundary). 


If a function f is defined at all node points, then f has a unique natural spline 
interpolant. If, in addition, f is differentiable at a and b, then f has a unique clamped 
spline interpolant. To construct a cubic spline, set 


Sj(x) = aj + bj(x — 23) + ¢j(a — a3)? + dj(x — 23)? 
for each j = 0,1,...,2—1. The constants {a,, bj, c;, dj} are found by solving a tri- 
adiagonal system of linear equations, which is included in the following algorithms. 


8.1.4.2 Algorithm for natural cubic splines 


INPUT: n, {20,71,---,2n}, where ao = f(%o),-.-, @n = f (an). 
OUTPUT: {a;,b;,¢;,d;} for 7 = 0, 1, see Me di. 





Algorithm: 
1. For i = 0,1,...,n —1, set h; = Lj41 — Vj. 
. Fort = 1,2,...,n—1, seta; = —(ai41—ai)— (ai —Qi-1). 
hj hj-1 








2 
3. Set Lo ie Lo 0, 20 0. 
4. Forti = 1,2,...,n—1, 
set £; = 2(@441 — 24-1) — Ay_1ma-1; 
set b= hy / i; 
set z; = (Qi; = hy_-12;-1)/€:- 
5. Set 2, = 1, zn, = 0, cn, = 0. 
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6. Forj =n—1,n—-—2,...,0, 
Set Cj = 23 — MyCj415 
set bj = (aj41 — aj) /hy — hg (cpp + 2c¢)/3; 
set dj = (¢j41 — ¢7)/(3h,). 
7. OUTPUT (a;,b;,c;,d; forj =0,1,...,.—1). STOP. 
8.1.4.3 Algorithm for clamped cubic splines 
INPUT: n, {%0,01,---, Un}, Fo = f’(x0), Fn = f' (an). 


ao = f (xo), a1 = f(®1),..-, Gn = f(@n), 
OUTPUT: {a;,b;,¢;,d;} for j = 0,1,...,n—1. 





Algorithm 
1. Forti =0,1,...,n—1, set hy = 241 — 
2. Set ago = 3(a1 — ao) /ho — 3Fo, Aan = aR. ” 3(a n—@n—1)/hn-1. 
3. Forti = 1,2,...,n—1, seta; = —(aj41 —a;) -——(aj;—aj_-1). 
hj hi-1 


4. Set Lo = 2ho, Ho = 0.5, 20 = ag/£o. 
5. Fort = 1,2,...,n—1, 
sett, = 2 — 21) — ea 
set b= hi / ba; 
set 2; = (Qj = hy_-12;-1)/&:- 
Set 0, = hn—1(2 = [n—1)s zn = (Qn a hn—12n—1)/ln, Cn = Zn. 
. Forj =n—1,n—-2,...,0, 
set Cj = 2) — MyjCj+13 
set bj = (aj41 — aj)/hy — hg (cpa + 2c)/3; 
set dj = (¢j41 — ¢7)/(3h,). 
8. OUTPUT (a,, bj, c;,d; for 7 =0,1,...,n — 1). STOP. 
8.1.4.4 Discrete approximation 


Another approach to fit a function to a set of data points {(x;, yi) | i = 1,2,...,m} 
is approximation. If a polynomial of degree n is used, then P, (x) = S07, anz* is 
found that minimizes the least squares error E = S~)", [yi — Py(2i)]|*. 
e Normal equations 
To find {ao, a1,...,@n}, solve the linear system, called the normal equations, 
created by setting partial derivatives of & taken with respect to each a; equal 
to zero. The coefficient of ag in the first equation is actually the number of data 
points, m. 


ID 





m m m m 
to Lj Peay x; haa) x? +. +a > a= yr, 
i=l i=l 


m m m m 


28 tai Yo tea) +. ee ae oe 
j=1 i=l 


m m i m 
ao 2 re +ay : atl + ag 2 rete tan s ge S yinr. 


(8.1.25) 
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Note: P,,(x) can be replaced by a function f of specified form. Unfortunately, 
to minimize L, the resulting system is generally not linear. Although these 
systems can be solved, one technique is to “linearize” the data. For example, if 
y = f(x) = be, then In y = Inb+ az. The method applied to the data points 
(a;,In y;) produces a linear system. Note that this technique does nor find 
the approximation for the original problem but, instead, minimizes the least- 
squares for the “linearized” data. 


e Best-fit line Given the points P, = (11,41), P2 = (%2,y2), ..., Ph = 
(n, Yn), the line of best-fit, which minimizes E, is given by y— J = m(x — 7) 
where 

ee (1 + 2o+...+2n) 
c= e dt = = : 
= lb (yr tyo+.--+Yn) mise 
_— nm dy n ? = 
w=1 
m a (Eid Baya t ---+ Tn) NEG _ FY TY 
(x? +az+...+22) — nF? mee 


If x and y are column vectors containing {«;} and {y;}, andj is an n x 1 vector 
of ones, then: F = x'j/n, J = y'j/n, TY = x'y/n, and 2? = x'x/n. 


8.1.5 BEZIER CURVES 


Bézier curves are widely used in computer graphics and image processing. Use of 
these curves does not depend on understanding the underlying mathematics. This 
section summarizes Bézier polynomials; the rational Bézier curves are not covered. 

Bézier curves are defined using parametric equations; the curves are not required 
to describe a function of one coordinate variable in terms of the other(s). A point P 
is interpreted as a vector and a Bézier curve has the form B(t) = [a(t), y(t)] (or 
B(t) = [a(t), y(t), 2(t)]) where the parameter ¢ satisfies 0 < ¢ < 1. 

A Bézier curve B(t) is a weighted average of the nm + 1 control points 


{Po, Pi,..., Py}, where the weights are the Bernstein basis polynomials: 
Bit) => (") G=-8r, 0<¢<1 (8.1.27) 
= 


The curve starts at Pp and ends at P,,. It is said to have order n + 1 (it has degree n) 
since it uses n + 1 control points. The first three orders are 


(Linear) B(t) = (1—t) Po+tPi 
(Quadratic) B(t) = (1—t)?Py9+2(1—t) tP, +t? Pp 
(Cubic) B(t) = (1 —#)3P) +3(1 —t)4P, + 3(1 — 1)? + BP, 
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Notes: 


e Bézier curves of degree n can be viewed as a linear interpolation of two curves 
of degree n — 1 since 


Brop,...p, (t) = (1— t)Bryp,...p,_1(t) + tBp, P,...p, (b) 


where Bas, M>...u,, denotes the Bézier curve using nodes {1, Mo,... My}. 


e The cubic Bézier curve is essentially the cubic Hermite interpolating polyno- 
mial. In general, the curve will not pass through {P;} fori 4 0 andi 4 n. 
These points are sometimes called guidepoints since they each provide a direc- 
tion for the curve. The line Pp P; (resp. P2 P3) is the tangent to the curve at P 
(resp. P,). 


e Bézier curves are often generated interactively so the user can vary the guide- 
points to modify the appearance and shape of the curve. 


The method to reproduce a given continuous curve is similar to spline interpolation. 
The given curve is divided into segments by choosing several points on the curve and 
a Bézier curve is used to interpolate between each pair of consecutive points. For 
example, using a cubic curve between each pair of nodes (each requires four nodes), 
two additional points must be selected to serve as guidepoints. The entire curve is 
then described using the collection of Bézier curves, creating a Bézier spline. Note 
that any changes made in one of the Bézier curves will only change the nodes of the 
adjacent Bézier curves. 

Bézier curves are infinitely differentiable so any continuity requirement imposed 
is satisfied, except where two Bézier curves are joined. Suppose two connecting 
Bézier curves, B, and Bo, of equal order are defined by the points { Po, Pi,..., Pr} 
and {Qo, Qi,..- Qn}, respectively, where Qo = P,,. The method of constructing the 
spline guarantees continuity (i.e., C°-continuity). C1-continuity requires P’(1) = 
Q’(0), so we must have Q; — Qo = P,, — Py-1. Combined with the previous 
condition this requires Q1 = 2P, — Ph—1 = Py + (Pn — Pn—1). Similarly, for 
C?-continuity, we would need P”’(1) = Q’(0), which requires Q2 to satisfy Q2 = 
4P,, — 4Py—-1 + Pnh—2 = Pn—2 + 4(Pn — Pn—1). In this way, nodes Q;, can be 
determined for continuity restrictions of higher order. 

The methods of constructing Bézier curves can be extended to define Bézier 
surfaces. A tensor product Bézier surface, called a Bézier patch of order n + 1 is 
defined by the (n + 1)? control points {P;,; | 0 < i,j < n}: 





” <s<l 


mee — 0 
P(s,t)= >> & (1—s)*1s8 > (") (1-2) P,,, for pope y 
j=0 ie 


1=0 


Each patch can be viewed as a continuous set of Bézier curves. Adjacent patches are 
linked in a manner similar to the way Bézier splines are formed from the individual 
Bézier curves so that desired continuity conditions are satisfied. 
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8.2 NUMERICAL LINEAR ALGEBRA 


8.2.1 SOLVING LINEAR SYSTEMS 


The solution of systems of linear equations using Gaussian elimination with back- 
ward substitution is described in Section 8.2.2. The algorithm is highly sensitive 
to round-off error. Pivoting strategies can reduce round-off error when solving an 
nm X n system. For a linear system Ax = b, assume that the equivalent matrix equa- 
tion A“*)x = b) has been constructed. Call the entry, alt) the pivot element. 


8.2.2 GAUSSIAN ELIMINATION 
To solve the system Ax = b, Gaussian elimination creates the augmented matrix 
Qt ++. Ain Oy 
A’ =[A:b]= | : ae (8.2.1) 
Gn1 +++ Ann bn 
This matrix is turned into an upper-triangular matrix by a sequence of (1) row per- 


mutations, and (2) subtracting a multiple of one row from another. The result is a 
matrix of the form (the primes denote that the quantities have been modified) 


ayy ayy a my Qin bY 

0 ayn ... ah, 05 
(8.2.2) 

0 ... O a, B, 


This matrix represents a linear system that is equivalent to the original system. If 
the solution exists and is unique, then back substitution can be used to successively 
determine {2,,Up—1,...}. 

8.2.2.1. Gaussian elimination algorithm 


INPUT: number of unknowns and equations n, matrix A, and vector b. 


OUTPUT: solution x = (x1,...,@n)" to the linear system Ax = b, 
or message that the system does not have a unique solution. 
Algorithm: 


1. Construct the augmented matrix A’ = [A : b] = (a;;) 
2. Fort = 1,2,...,m— 1 do (a)-(c): (Elimination process) 
(a) Let p be the least integer with 2 < p < n and Anyi #0 
If no integer can be found, then 
OUTPUT(‘“no unique solution exists”). STOP. 
(b) If p 4 7 interchange rows p and i in A’. The new matrix is A’. 


(c) Forj =7+1,...,n doit 
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i. Set mij = a5;/a4;. 
ii. Subtract from row 7 the quantity (m,,; times row 7). 
Replace row 7 with this result. 


3. If a’,,, = 0 then OUTPUT (“no unique solution exists”). STOP. 
4. Set pn = Gy n41/Ayn- (Start backward substitution). 


nn" 


5. Fort == 1.252, 1 sete = Eee are alsa] £ Qe: 
6. OUTPUT (a1,...,%n), (Procedure completed successfully). 
STOP. 


8.2.2.2 Pivoting 


Maximal column pivoting 
Maximal column pivoting (often called partial pivoting) finds, at each step, the 
element in the same column as the pivot element that lies on or below the main 
diagonal having the largest magnitude and moves it to the pivot position. De- 


termine the least p > k such that Jat? = MaXK<i<n 





al? and interchange 
the k'* equation with the p" equation before performing the elimination step. 

Scaled-column pivoting 
Scaled-column pivoting sometimes produces better results, especially when 
the elements of A differ greatly in magnitude. The desired pivot element is 
chosen to have the largest magnitude relative to the other values in its row. 
For row i define a scale factor s; by s; = max)<;<n |ai;|._ The desired 
pivot element at the k step is determined by choosing the least integer p 


k 
at? /8;. 





with Jat? /Sp = MAXK<j<n 

Maximal (or complete) pivoting 
The desired pivot element at the k step is the entry of largest magnitude 
among {a,;;} withi =k,k+1,...,nandj =k,k+1,...,n. Both row and 
column interchanges are necessary and additional comparisons are required, 
resulting in additional execution time. 


8.2.3 EIGENVALUE COMPUTATION 
8.2.3.1 Power method 


Assume that the n x n matrix A has n eigenvalues {A1, A2,..., An} with linearly 
independent eigenvectors {y), G0") cra; yi, Assume further that A has a unique 
dominant eigenvalue Aj, that is || > |A2| > |As| > --: > |An|. Note that for any 
xeER" x= ae ajv), 

The algorithm is called the power method because powers of the input matrix 
are taken: A*x ~ \¥a,v\) as k —- 00. However, this sequence converges to zero if 
|Ai| < 1 and diverges if |\,| > 1, provided a; 4 0. Appropriate scaling of A*x is 
necessary to obtain a meaningful limit. Begin by choosing a unit vector x) having 
a component a) such that ao) =l= [|x ||. 

The algorithm inductively constructs sequences of vectors {x poo and 
{y(™)}°°_| and a sequence of scalars { ju") }°°_, by 
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(m) 
m mM m m m y 
ym) = Axim DM aye) xt =, (8.2.3) 
Yom 
where, at each step, p,, represents the least integer for which lube = lly | 





The sequence of scalars satisfies limo pe = 1, provided a; 4 0, and 


the sequence of vectors {x"") }°°_) converges to an eigenvector associated with Aj 
that has /,, norm one. 


8.2.3.2 Power method algorithm 


INPUT: dimension n, matrix A, vector x, tolerance TOL, and 
maximum number of iterations NV. 
OUTPUT: approximate eigenvalue ju, 
approximate eigenvector x (with ||x||_. = 1), 
or a message that the maximum number of iterations was exceeded. 
Algorithm: 
1. Set k=1. 
2. Find the smallest integer p with 1 < p < nand |z,| = ||x||.. 
3. Setx =x/zp. 
4. While (k < N) do (a)-(g): 
(a) Sety = Ax. 
(b) Set = yp. 
(c) Find the smallest integer p with 1 < p < nand |y,| = |ly||,.- 
(d) If y, = 0 then OUTPUT (“Eigenvector,” x, “corresponds to 
eigenvalue 0. Select a new vector x and restart.”); STOP. 
(e) Set ERR = ||x — y/Ypl| 3X = ¥/Yp- 
(f) If ERR < TOL then OUTPUT (1, x) 
(procedure successful) STOP. 
(g) Seth =kA+1. 
5. OUTPUT (“Maximum number of iterations exceeded”). STOP. 
Notes: 
1. The method does not require that A; be unique. If the multiplicity is greater 
than one, the eigenvector obtained depends on the choice of x), 
2. The sequence constructed converges linearly, so that Aitken’s A? method 
(Equation (8.1.1)) can be applied to accelerate convergence. 


8.2.3.3 Inverse power method 


The inverse power method modifies the power method to yield faster convergence 
by finding the eigenvalue of A that is closest to a specified number g. Assume that 
A satisfies the conditions as before. If ¢g 4 \;, fori = 1,2,...,n, the eigenvalues 
of (A—qI)~1 are vert rere iin wert with the same eigenvectors v),..., v'"). 
Apply the power method to (A — qI)~!. At each step, y°”) = (A — qI)~!x(™—)), 
Generally, y“"”) is found by solving (A — ql)y™ = x("—) using Gaussian elimi- 
nation with pivoting. Choose the value q from an initial approximation to the eigen- 
vector x) by g = x0)" Ax(0) / (x"x } 
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The only changes in the algorithm for the power method are to set an initial 
value qg as described (do this prior to step 1), determine y in step (4a) by solving the 
linear system (A — qI)y = x. (If the system does not have a unique solution, state 
that q is an eigenvalue and stop.), delete step (4d), and replace step (4f) with 


1 
if ERR < TOL then set p = —+q; OUTPUT (1, x); STOP. 
mM 


8.2.3.4 Wielandt deflation 


Once the dominant eigenvalue (A;) has been found, the remaining eigenvalues can 
be found by using deflation techniques. A new matrix B is formed having the same 
eigenvalues as A, except that the dominant eigenvalue of A is replaced by 0. 

One method is Wielandt deflation which defines x = wa) [ai1 Gig ... Gin], 
where uo) is a coordinate of v‘) that is non-zero, and the values {aj1, Qi2, ---, Qin} 
are the entries in the i" row of A. Then the matrix B = A—, vx" has eigenvalues 


0, 2, A3,---; \n With associated eigenvectors {v“), w?), w®), ..., w°}, where 
v) = (Ay — Ar)wO + Aq(xTwO vO) (8.2.4) 





for? = 2,3,...,n. 

The i" row of B consists entirely of zero entries and B may be replaced with an 
(n — 1) x (n — 1) matrix B’ obtained by deleting the 7” row and 7" column of B. 
The power method can be applied to B’ to find its dominant eigenvalue and so on. 


8.2.4 HOUSEHOLDER’S METHOD 


Definition = Twon xn matrices A and B are similar if a non-singular matrix S' exists with 
A= S7~'BS. (If A and B are similar, then they have the same set of eigenvalues). 
Householder’s method constructs a symmetric tridiagonal matrix B that is similar to 
a given symmetric matrix A. After applying this method, the QR algorithm can be 
used efficiently to approximate the eigenvalues of the resulting symmetric tridiagonal 
matrix. 
8.2.4.1. Algorithm for Householder’s method 
To construct a symmetric tridiagonal matrix A("~!) similar to the symmetric matrix 
A = A), construct matrices A®?), A@),..., A(-)), where AM) = (a\”) fork = 
1,2,...,n—1. 
INPUT: dimension n, matrix A. 
OUTPUT: A»), (At each step, A can be overwritten.) 
Algorithm: 
1. Fork =1,2,...,n — 2 do (a)-(k). 
k 
(a) Set g = WP gy 1 (al®))?. 
(b) If at"), ,, =0 then set a = —q? 
(k) 


1 
else set a = —q? G44) 4 / |R41,6 





on 


2: 
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(c) Set RSQ = a? — eae ‘ 
(d) Set vz, = 0. (Note: vy, = = Up—1 = O, but are not needed.) 
Set Ups1 = re — a; 


i (k) 
for j =k+2,...,nsetu; =aj,’. 


(@) Forg =h,k+ 1,.c..nsetuy = (Oe a\t y;) /RSQ. 


(f) Set PROD = 7", ,, Viti. 
(g) Forj = k,k+1,...,7 set 2; = uz — (PROD/2RSQ)o;. 








(h) For@=k+1,k+2,...,n—1doi-i. 
i. Forjg = €+1,...,n seta ie = a7 — VEZ; — V5} 
a = (kD 
il. Set alkt) _ = ash) — Qveze. 
(i) Set aft? = alt) — Qunzn. 


j) Forj =k+2,...,nset ore = ger = 0. 
GQ) J , 





jk 
(kK+1) _ _(k ‘ (k+1) _ g(kt) 
(k) Set apyy = egig — UktIZeS G41 = Fk: 


(Note: The other elements of A‘ (k-+1) ) are the same as A(*).) 


OUTPUT (A‘”—)), STOP. 
(AG) is symmetric, tridiagonal, and similar to A.) 


8.2.5 QR ALGORITHM 


The QR algorithm is generally used (instead of deflation) to determine all of the 
eigenvalues of a symmetric matrix. The matrix must be symmetric and tridiagonal. 
If necessary, first apply Householder’s method. Suppose the matrix A has the form 


ay bo 0 ee 0 0 0 
bz ag b3 0 0 0 
0 bg ag 0 0 0 
A=|: 7 ae (8.2.5) 
0 O O Qn—-2 dni O 
0 O O bn—-1 An—1 On, 
0 0 QO ::- 0 bn an 


If b2 = O or by, = 0, then A has the eigenvalue a1 or an, respectively. If b; = 0 for 
some 7, 2 < j <n, the problem is reduced to considering the smaller matrices 








0 0 aj bj44 0 0 

b3 0 bj+1 Qj+1 bj+2 0 

a3 0 0 bj+2 Qj+2 0 
and |. . (8.2.6) 

a; 2 b; 1 0 0 An—-1 bn 
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If no b; equals zero, the algorithm constructs A“), A@), A). as follows: 
1. AD = A is factored as AY = QM RO, with QM orthogonal and RM 
upper-triangular. 
2. A(®) is defined as A?) = RYQM, 


In general, ACH) = ROQ® = (QO*AM)QO = QOTAMQM, Each AG) 
is symmetric and tridiagonal with the same eigenvalues as A“) and, hence, has the 
same eigenvalues as A. 

8.2.5.1 Algorithm for QR 


To obtain eigenvalues of the symmetric, tridiagonal n x n matrix 


a) oY 9 0 0 0 
Bo) gf) pw) 0 oO 0 
0 Bh a 0 oO 0 
A=A,=|: =. 2 lis (8.2.7) 
0 Oo 0 av, oY, 0 
0 oO 0 BD a, a) 
0 0 O -- oO BP a 


INPUT: n; {a?, ..., a, bSY, ..., bo}, tolerance TOL, and 
maximum number of iterations M. 
OUTPUT: eigenvalues of A, or recommended splitting of A, 
or a message that the maximum number of iterations was exceeded. 
Algorithm: 


1. Set k = 1; SHIFT = 0. (Accumulated shift) 
2. While k < M, do steps 3-12. 
3. Test for success: 


(a) If = a\*) + SHIFT; OUTPUT (A); 





setn =n— ot 
(b) If se < TOL then set A = a") + SHIFT; OUTPUT ()); 
setn=n-—1; al*) = as"). 
for 7 = 2,...,n set an = an pW) = ae 
(c) Ifn = 0 then STOP. 
(d) If n = 1 then set \ = a\”) + SHIFT; OUTPUT(A); STOP. 
(e) Forj = 3,...,n—1 
if 2]. < TOL then 
OUTPUT (“splitinto,” {ay”, 0:05? bE ces Beh, 
Mand a stig ob acta” hs SHIFT); STOP. 


4. Compute shift: 
set b = —(a, +a): c= aa, — [6]; d = (0? — 4c)2. 
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5. If b > 0, then set py = —2c/(b+ d); wo = —(b+ d)/2; 
else set 1 = (d — b)/2; pug = 2c/(d— b). 
6. If n = 2, then set Ay = uy + SHIFT; Ag = pe + SHIFT; 
OUTPUT (Ai, Az); STOP. 
(k) 


(k) (k) 











7. Choose s so that s — an | = min Iya — an’ |,|M2—- an ). 
8. Accumulate shift: Set SHIFT = SHIFT + s. 
9. Perform shift: For 7 = 1,...,n setd; = a —s. 


10. Compute R™) : 
(a) Set Ly = dy; Y= by. 
(b) For j = 2,...,n 
set 231 = (@2_, + [Bf?)8s cy = 24-1 /z5-15 
set 5; = OY (apa Qj—1 = CjYj—1 + 8545; 
set 2; = —8;y;-1 + cjd;. 


If j x n then set ry1= abe Y= ee 


(At this point, a = P; AY has been computed (P; is a rotation 
matrix) and R(*) = AS) 

11. Compute A(*t+)), 
(a) Set 2) = @n3 alk+3) = Saqi + C2213 
(b) For 7 = 2,3...,n—1, 


set ceo 


k+1 
set ae _ 8j412541- 


(c) Set ace it ey 
12. Settk=k+1. 


13. OUTPUT (“Maximum number of iterations exceeded”’); 
(Procedure unsuccessful.) STOP. 


Bt) = 8929. 


= 854105 F CjC5 41253 


8.2.6 NON-LINEAR SYSTEMS AND NUMERICAL OPTIMIZATION 
8.2.6.1 Newton’s method 


Many iterative methods exist for solving systems of non-linear equations. Newton’s 
method is a natural extension from solving a single equation in one variable. Con- 
vergence is generally quadratic but usually requires an initial approximation that 
is near the true solution. Assume F(x) = 0 where x is an n-dimensional vector, 
F : R” — R”", and 0 is the zero vector. That is, 


F(x) = F(a, 2a,-.+5%n) = [fil@1,@2)-++,8n),-++> fn (1, H2,---s Bn) 


A fixed-point iteration is performed on G(x) = x — (J(x))~'F(x) where J(x) is the 
Jacobian matrix, 
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Ofi(x) Afr) Of. (x) 
Ox 0x2 OX, 
Ofo(x) Ofe(x) ... Ofalx) 
ig=|)" iid (8.2.8) 
Ofn(x) Ofn(x) .,.  Ofn(x) 
Ox 0x2 Oxn, 
The iteration is given by 
x = GeO D) = xD _ [7@leV)) R(K®D), (8.2.9) 


The algorithm avoids calculating (.J(x))~' at each step. Instead, it finds a vector y 
so that J(x*—1))y = —F(x(*—)), and then sets x(*) = x(*-1) + y, 

For the special case of a two-dimensional system (the equations f (a, y) = 0 and 
g(x, y) = O are to be satisfied), Newton’s iteration becomes: 








ts = ty — ea fod 
fe Gy _ fy Gu L=Ln Y=Yn 
(8.2.10) 
deat = Yn — Oe 9 
fudy — fyGx 





G=Ln,Y=Yn 


8.2.6.2 Method of steepest-descent 


The method of steepest-descent determines the local minimum for a function of the 
form g : R” — R. It can also be used to solve a system { f;} of non-linear equations. 
The system has a solution x = (11, £2,... sity when the function 


n 


g(@1,2,...,Ln) = S [fir x2, seer (8.2.11) 


i=l 


has the minimal value zero. 

This method converges only linearly to the solution but it usually converges 
even for poor initial approximations. It can be used to locate initial approximations 
that are close enough so that Newton’s method will converge. Intuitively, a local 
minimum for a function g : R” — R can be found as follows: 

1. Evaluate g at an initial approximation x) = (2), tO), 
2. Determine a direction from x) that results in a decrease in the value of g. 
3. Move an appropriate distance in this direction and call the new vector x“), 
4. Repeat steps | through 3 with x) replaced by x“), 


The direction of greatest decrease in the value of g at x is the direction given by 
—V q(x) where Vg(x) is the gradient of g. 


Definition If g:R” > R, the gradient of g atx = (a1,..., an)", denoted Vg(x), is 


a a a . 
Vg(x) = (stm. a) ane (x) (8.2.12) 
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Thus, set x‘) = x) — @Vg(x)) for some constant a > 0. Ideally the value 
of a minimizes the function h(a) = g(x — aVg(x)). Instead of tedious di- 
rect calculation, the method interpolates h with a quadratic polynomial using nodes 
Q1, 2, and ag that are hopefully close to the minimum value of h. 


8.2.6.3 Algorithm for steepest-descent 


To approximate a solution to the minimization problem ay g(x), given an initial 
xe R” 
approximation x. 


INPUT: number n of variables, initial approximation x = 


(Elves ce ae tolerance TOL, and maximum number of iterations NV. 
OUTPUT: approximate solution x = (41, %2,.-.,2n)" 
or a failure message. 
Algorithm: 
1. Setk=1. 


2. While (& < N), do steps (a)—(k). 

(a) Set: gi = g(a1,...,%n); (Note: gi = g(x‘*)).) 
z= Vg(a1,..-,2n); (Note: z = Vg(x"?).) 
20 = |lz\l>- 

(b) If z9 = 0 then OUTPUT (‘Zero gradient’); 
(Procedure completed, may have a minimum.) 
OUTPUT (a1,...,%n, 91); STOP. 

(c) Set z = z/z9. (Make z a unit vector.) 

Set a, = 0; a3 = 1; g3 = g(x — 032). 
(d) While (g3 > gi), do steps iii. 
i. Set a3 = a3/2; g3 = g(x — a3Z). 
ii. If a3 < TOL/2, then 
(Procedure completed, may have a minimum.) 
OUTPUT (“No likely improvement’); 
OUTPUT (a1,...,2n,91); STOP. 


(e) Set ag = a3/2; go = g(x — a2Z). 
(f) Set: hi = (g2 — g1)/a2; he = (93 — g2)/(a3 — a2); 
hg = (he = hy)/as. 
(g) Set: ag = (ag — hi/hg)/2; (Critical point occurs at ao.) 
Jo = g(X — aoz). 
(h) Find a from {ao, a3} so that g = g(x — az) = min{go, gs}. 
(i) Setx = x — az. 
(j) If |g — 91| < TOL then OUTPUT (a1,...,2n,9); 
(Procedure completed successfully.) STOP. 
(k) Seth =k+1. 


3. OUTPUT (“Maximum iterations exceeded”’); 
(Procedure unsuccessful.) STOP. 
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8.3. NUMERICAL INTEGRATION AND 
DIFFERENTIATION 


8.3.11 NUMERICAL INTEGRATION 


Numerical quadrature involves estimating c f(x) dx using a formula of the form 


b n 
/ f(x)dz => cif (ai). (8.3.1) 
a i=0 
8.3.1.1 Newton—Cotes formulas 
A closed Newton—Cotes formula uses nodes x; = 9 + th fori = 0,1,...,, where 
h = (b—a)/n. Note that 79 = a and x, = b. 
An open Newton—Cotes formula uses nodes x; = %9 + th for? = 0,1,...,n, 


where h = (b— a)/(n + 2). Here rp =a+handa, = b—h. Set x_; = a and 
XLn+1 = b. The nodes actually used lie in the open interval (a, b). 
In all formulas, € is a number for which a < € < band f; denotes f(2;). 


8.3.1.2 Closed Newton—Cotes formulas 
l. m=1) pees rule 


a f(a) de = 21 f(a) + f(e)] - 
2. (n= 2) Saino s tule 

[ steyae = Bip) + 47(01) + Fea - RIO, 
3. (n=3) ae s three-eighths rule 

[ f(a) de = “Uy (ao) + 3f(01) + 3f (22) + F(2s)] - 
4. (n = 4) Milne’s rule (also called Boole’s rule) 

[so dz = A Irho + 32f, + 12fo + 32f3 + 7fa] — Sh (6). 


S. = 5) 


he M 
ah". 


ah” 
(4) 
(8) 





275h7 
[ f(x) dx = 219 fo $75 fi +50 f2+50 fo +75 fa 19f5]— ‘ooael 
6. (n = 6) Weddle’s rule 
[is f(x = Th igi fy 4 216 f, +27 fo4 + 272 f3 +27 fs +216 fs +41 fo] 
Sh” p96), 
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8.3.1.3 Open Newton-Cotes formulas 
1. = = 0) Midpoint rule 


[ fou—oraps * #6). 





1 Gat 
Hayao = igloo) + seen) + Ey"), 
3. (n = 2) 
1a) de = Megas) — sen) +2400 + WE poe. 
4. (n= 3) 
F(a) de = Serr flaa) + Has) + Flea) + We] + BRIE, 
5. (n =A) 
1) dx = = 11 fo — 14f1 + 26 fo — 14f3 + 11 fa] + AN ((), 


8.3.1.4 Composite rules 


Some Newton—Cotes formulas extend to composite formulas. This consists of di- 
viding the interval into sub-intervals and using a Newton—Cotes formulas on each 
sub-interval, In the following, note that a < yu < b. 


1. Composite trapezoidal rule for n subintervals: If f € C?[a, b],h = (b—a)/n, 
and x; =a+ jh, for 7 =0,1,...,n, then 


[soa = £1 F(a) 0)42 se) +50] 221 F"(H). 


2. Composite Simpson’s rule for n subintervals: If f € C*[a,b],n is even, h = 
(b—a)/n, anda; =a+ jh, for j =0,1,...,n, then 


(n/2)-1 n/2 
[sou = (F(a) )+2 yy f (x25) +4D Sl 23-1) + f(b) 
_ b= 4) 4 04) 
ip t fH) 


3. Composite midpoint rule for n + 2 subintervals: If f € C?[a,b],n is even, 
h = (b—a)/(n+2), and xz; =a+(j+I1)h, for 7 = —1,0,1,...,n+1, then 


n/2 


[is f(a ea Dealt 





f"(u). 
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8.3.1.5 Romberg integration 


Romberg integration uses the composite trapezoidal rule beginning with h; = b — 
a and hy = (b— a)/2*~!, for k = 1,2,..., to give preliminary estimates for 
ic f(x) dx and improves these estimates using Richardson’s extrapolation. Since 
many function evaluations would be repeated, the first column of the extrapolation 
table (with entries denoted R;,;) can be more efficiently determined by the following 
recursion formula: 





h b-—a 
Rii= 5 l(a) + F()] = IF (@) + FO), 

7 gh-2 (8.3.2) 
Rea = 3 Ry-11 + he-1 > f(a + (21 —1)he)] , 


for k = 2,3,.... Now apply Equation (8.1.4) to complete the extrapolation table. 
8.3.1.6 Gregory’s formula 
Using f; to represent f(xo + jh), 


xotnh 1 1 
/ Fly) dy =h(S fot f+... + fr-1 + 5 fn) 


LO 


h h 
+ Tp Ato <a A fn—1) = ag (hfo at ge aes 
19h 5 , OF pad P 
+ rag lA* fo — A®*fn—s) — TeG(A* fo + AY faa) +---- (8.3.3) 


where A’s represent forward differences. The first expression on the right is the com- 
posite trapezoidal rule, and additional terms provide improved approximations. Do 
not carry this process too far; Gregory’s formula is only asymptotically convergent 
and round-off error can be significant when computing higher differences. 


8.3.1.7 Gaussian quadrature 


A quadrature formula, whose nodes (abscissae) x; and coefficients w; are chosen 
to achieve a maximum order of accuracy, is called a Gaussian quadrature formula. 
The integrand usually involves a weight function w. An integral in t on an interval 
(a,b) must be converted into an integral in x over the interval (a, 3) specified for 
the weight function involved. This can be accomplished by the transformation x = 


os dy ao, Gaussian quadrature formulas generally take the form 








B 
7 w(x) f(x) dx = yD wif (ai) + Ep (8.3.4) 


where the error is E,, = Kage) for some a@ < € < Gand K,, is aconstant. The 
next table contains many weight functions and their associated intervals. 

The subsequent tables give abscissae and weights for selected formulas. If some 
x; are specified (such as one or both end points), then use the Radau or Lobatto 
methods. 
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FIGURE 8.2 


Formulae for integration rules with various weight functions 





“(1 = (@)m) ejnuios orpussoT-ssney ot ur fx JF JYS!om Surpuodsa.too oy} sa}ouap *y pue “UUINTOS snorAard 
ay} Jo (x)I+VZy Jo (x)“q Jo JOOI aantsod ,,2 ay} sajouep {x ‘ospy ‘Ajaanoodsax ‘sjermoudyod tqooer pur ‘(9 Pury 


puooses ‘47, PuPy ISIY) AdYsSAqoy_ ‘ay WH ‘aLanse’yT ‘aipuasayT us oy} ajouap “pur “TET ST “ey ‘aqey sty Uy 








JO SOIOz are (g ‘70) (x)m 
sessloqy [earoquy WBIONA 


672 CHAPTER 8. SCIENTIFIC COMPUTING 


8.3.1.8 Gauss—Legendre quadrature 


Weight function is w(x) = 1. 





Nodes {+2;} | Weights {w;} 


2 | 0.5773502692 


0.7745966692 


4 | 0.3399810436 
0.8611363116 


1 


0.8888888889 
0.5555555556 


0.6521451549 
0.3478548451 


/ f(a) de x Yo wise 





niomcontl 
0.9061798459 


0.2386191861 
0.6612093865 
0.9324695142 


8.3.1.9 Gauss—Laguerre quadrature 


Weight function is w(x) = e~”. 


Nodes {x;} | Weights {w;} 


2 | 0.5857864376 
3.4142135623 


3 | 0.4157745567 
2.2942803602 
6.2899450829 


0.8535533905 
0.1464466094 


0.7110930099 
0.2785177335 
0.0103892565 


je 


0. Se 
1.7457611011 
4.5366202969 
9.3950709123 


0.2635603197 
1.4134030591 
3.5964257710 
7.0858100058 
12.6408008442 


8.3.1.10 Gauss—Hermite quadrature 


ka — {+a;} | Weights {w;} 


0.5688888889 
0.4786286705 
0.2369268851 


0.4679139346 
0.3607615730 
0.1713244924 





\dx x is wif (xi). 


pe [Noes oa] Weghes Tan] 


0.6031541043 
0.3574186924 
0.0388879085 
0.0005392947 


0.5217556105 
0.3986668110 
0.0759424496 
0.0036117586 
0.0000233699 





Weight function is w(a) = e~* 


/ eC x) da = S~ wif (ai) 
—o0 i=l 
i = {+2;} | Weights {w;} 








Nodes {+2;} | Weights {w;} 


2 | 0.7071067811 


1.2247448713 


4 | 0.5246476232 
1.6506801238 


0.8862269254 


1.1816359006 
0.2954089751 


0.8049140900 
0.0813128354 


nostuiels 
2.0201828704 


0.4360774119 
1.3358490740 
2.3506049736 


0.9453087204 
0.3936193231 
0.0199532420 


0.7246295952 
0.1570673203 
0.0045300099 
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8.3.1.11  Radau Gpeciotre 


i f(x) dz =wif(- D+ Doms vi) 6) 


)+Pn (x) 


where each free node x; is the i" root of Pre te and w; = =~“, for 


n?[Pr—1(@i)]? 
i =2,...,n, see the following table. Note that 7; = —1 and w, = 2/n?. 


Weighs Twi] 
—0.2898979485 | 1.0249716523 
0.6898979485 | 0.7528061254 


pe [ Nodes [weighs (ur) 


—0.8029298284 | 0.3196407532 
—0.3909285467 | 0.4853871884 
0.1240503795 | 0.5209267831 
0.6039731642 | 0.4169013343 


—0.5753189235 | 0.6576886399 


0.1810662711 | 0.7763869376 0.9203802858 | 0.2015883852 


0.8228240809 | 0.4409244223 
—0.8538913426 | 0.2392274892 
—0.5384677240 | 0.3809498736 
—0.1173430375 | 0.4471098290 
0.3260306194 | 0.4247037790 
0.7038428006 | 0.3182042314 
0.9413671456 | 0.1489884711 


—0.7204802713 | 0.4462078021 
—0.1671808647 | 0.6236530459 
0.4463139727 | 0.5627120302 
0.8857916077 | 0.2874271215 





8.3.1.12 Lobatto quadrature 


/ F(a) de = wy (1) + nf) 


— n(n — 1)322"-1I(m — 2)1]4 paio 
+ do wif (ai) = a 6) 


where x; is the (i — 1)* root of P)_,(a) and w; = TET RO fori = 
2,...,2—1. Note that x} = —1, 2, = 1, and wy = wy = 2/(n(n — 1)). 








kia Nodes {tai} | Weights {w;} Ea Nodes {2;} | Weights {w;} 


1.3333333333 0.2852315164 | 0.5548583770 
0.3333333333 0.7650553239 | 0.3784749562 
0.0666666666 
4 | 0.4472135954 | 0.8333333333 


0.1666666666 0.4876190476 

0.4688487934 | 0.4317453812 

0.7111111111 0.8302238962 | 0.2768260473 

0.6546536707 | 0.5444444444 1 0.0476190476 
1 0.1000000000 
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8.3.1.13 Chebyshev quadrature 
1 9 n 
-l i=1 


[i [Nodes (Em: 
7/10 


0.5773502691 











0.3745414095 0.38239118105 
0 0.8324974870 0.5296567752 


0.7071067811 0.8838617007 
0.2666354015 

0.1875924740 0.4225186537 

0.7946544722 0.8662468181 





8.3.1.14 Multiple integrals 


Quadrature methods can be extended to multiple integrals. The general idea, using 
a double integral as an example, involves writing the double integral in the form of 
an iterated integral, applying the quadrature method to the “inner integral” and then 
applying the method to the “outer integral.” 


8.3.1.15 Simpson’s double integral over a rectangle 

To integrate f(x,y) over a rectangular region R = {(,y) |a<u<b,c<y<d} 
using the composite Simpson’s Rule produces the formula given below. Intervals 
(a, b] and [c, d] must be partitioned using even integers n and m for evenly spaced 


mesh points 7%, 21,...,@, and Yo, Y1,---, Ym; respectively. 
b d hk nm 
[ f fendavae= [of senayie= Fes tenu) +B 
a 7¢ i=0 j=0 
(8.3.5) 
where the error term £ is (here, h = (b — a)/n and k = (d — c)/m) 
(d—e)(b—a@) sOF aa Pee i te 5s 
B= —-———_ |h*§— k*— 3. 
130 Ay (ih B) + Oy! (7), ft) (8.3.6) 





Similarly, Simpson’s Rule can be extended for regions that are not rectangular. It is 
simpler to give the following algorithm than to state a general formula. 
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8.3.1.16 Simpson’s double integral algorithm 
a 
To approximate the integral J = [ i (x, y) dy da: 
(x) 
INPUT endpoints a, b; even positive integers m, n; 
functions c(x), d(x), and f(x, y) 
OUTPUT approximation J to I. 
Algorithm: 
1. Seth = (b—a)/n; J, =0; (End terms.) 
Jz = 0; (Even terms.) J3 = 0. (Odd terms.) 
2. Forz = 0,1,..., do (a)—(d). 
(a) Setx =a-+ih; (Composite Simpson’s method for x.) 
HX = (d(x) — e(x))/m:; 
Ky, = f(a,c(x)) + f(a, d(x)); (End terms.) 
Kz =0; (Even terms.) 
K3=0. (Odd terms.) 
(b) For 7 = 1, 2,...,m — 1 doi-ii. 
i. Sety=c(x) + fjHX; Q= f(x,y). 
ii. If 7 is even then set Ky = K2+Q else set K3 = K3+Q. 
(c) Set LD = (Ky +2K2+4K3)HX/3. 


d(x;) 
(z ~ / 


cla; 
(d) Ift = Oorz =n then set Jy = J, + LD; 
else if 2 is even then set Jo = Jo 4+ L; 
else set J3 = J3 + L. 
3. Set J = h( Jy + 2Jo + 43) /3. 
4. OUTPUT(./); STOP. 


f (xi, y) dyby composite Simpson’s method. } 


8.3.1.17 Gaussian double integral 


ae 
To apply Gaussian quadrature to [ = [ oe: (x, y) dy da, first requires trans- 


forming, for each x in [a, b], the interval [c(a 4 d(x)] to [—1,1] and then applying 
Gaussian quadrature. This is performed in the following algorithm. 


8.3.1.18 Gauss—Legendre double integral 
ae 
To approximate the integral J = [ i: (x, y) dy da: 
(2) 
INPUT endpoints a, b; positive integers m, n; the needed roots r;,; 
and coefficients c;,; fori = max{m,n} and for 1 < j <1. 
(From table on page 672) 
OUTPUT approximation J to I. 
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Algorithm: 
1. Sethi = (b—a)/2; ho = (b+a)/2; J=0. 
2. Forz = 1,2,...,m do (a)-(c). 
(a) Set JX = 0; 
&=hirmas + hea; 
dy =d(x); cy = c(x); 
ky = (dy = c1)/23 ko = (dy + c1)/2. 
(b) For 7 = 1, 2,...,n do 
set Y= Kirn + ko; 
Q = flasy)s 
JX = JX + en jQ. 
(c) Set J =J+emiki SX. 
3. Set J= hy J. 
4. OUTPUT(./); STOP. 


8.3.1.19 Double integrals of polynomials over polygons 


Jf y (8.3.7) 


m'n! as me is j Lk mtn—j—k Lith He 
——_. Wi . ol cre Yit1- 
ta =0 





n—k 


8.3.1.20 Monte—Carlo methods 


Monte-Carlo methods, in general, involve the generation of random numbers (ac- 
tually pseudorandom when computer-generated) to represent independent, uniform 
random variables over [0, 1]. Section 7.6 describes random number generation. Such 
a simulation can provide insight into the solutions of very complex problems. 
Monte-Carlo methods are generally not competitive with other numerical meth- 
ods of this section. However, if the function fails to have continuous derivatives 
of moderate order, those methods may not be applicable. One advantage of Monte— 
Carlo methods is that they extend to multidimensional integrals quite easily, although 
here only a few techniques for one-dimensional integrals [ = i g(a) dx are given. 


8.3.1.21 Hit or miss method 


Suppose 0 < g(a) <aqa<u<b,andQ = {(27,y)|a<a<b0<y<c}. If 
(X, Y) is arandom vector which is uniformly distributed over 2, then the probability 
p that (X,Y) lies in S (see Figure 8.3) is p = I/(c(b—a)). 

If N independent random vectors {(X;, Y;)}_, are generated, the parameter p 
can be estimated by p = Ny /N where Ny is the number of times Y; < g(X;), 7 = 
1,2,...,N, called the number of hits. (Likewise N — Ny is the number of misses.) 
The value of J is then estimated by the unbiased estimator 0; = c(b — a)Ny/N. 
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FIGURE 8.3 


Illustration of the Monte-Carlo method. The sample points are shown as circles; the solid 
circle is counted as a “hit,” the empty circle is counted as a “miss.” 




















8.3.1.22 Hit or miss algorithm 
1. Generate {U; aan of 2N random numbers, uniformly distributed in [0, 1). 
2. Arrange the sequence into N pairs (U1, U{), (U2, U3), ..., (Un, UN), so that 
each U; is used exactly once. 


3. Compute X; = a + U;(b — a) and g(X;) for? = 1,2,...,N. 
4. Count the number of cases Nz, for which g(X;) > cU}. 
5. Compute 6; = c(b — a)Na/N. (This is an estimate of J.) 


The number of trials N necessary for P(|@1 — I| < €) > ais given by 


v> Lepiplete =a)? 


eC (8.3.8) 


With the usual notation of z, for the value of the standard normal random vari- 
able Z for which P(Z > z.) = a (see page 628), a confidence interval for J with 
confidence level 1 — a is 


pl — p)(o— ajc 
Tr ; 





(8.3.9) 


0, aie ee 
8.3.1.23 The sample-mean Monte-Carlo method 
Write the integral J = r g(x) dx as ic an. fx (ax) dz, where f is any probability 


a fx(x 


density function for which fx(a) > 0 when g(x) 4 0. Then J = E W(X) 








Fx (X) 
where the random variable X is distributed according to fx (a). Values from this 
distribution can be generated by the methods discussed in Section 7.6.2. For the case 
where fx (x) is the uniform distribution on [0, 1], J = (b— a)E[g(X)]. An unbiased 
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estimator of J is its sample mean 
0 = (b 9 (X,) (8.3.10) 
2=> a N 4 g i). adie 


It follows that the variance of @2 is less than or equal to the variance of 6;. In fact, 


var 6; = <le(b —a)— I], 


b 
var 05 == loo Poyar P| . 


Note that to estimate J with 6; or 02, g(a) is not needed explicitly. It is only neces- 
sary to evaluate g(x) at any point «. 


(8.3.11) 


8.3.1.24 Sample-mean algorithm 


1. Generate {U;}_, of N random numbers, uniformly distributed in [0, 1). 
2. Compute X; = a+ U;(b—a), fori = 1,2,...,N. 

3. Compute g(X;) fori = 1,2,...,N. 

4. Compute 62 according to Equation (8.3.10) (This is an estimate of J). 


8.3.1.25 Integration in the presence of noise 
Suppose g(x) is measured with some error: g(x;) = g(ai) + &, for? = 1,2,...,.N, 
where €; are independent identically distributed random variables with E [e;] = 0, 
var(e;) = 0, and |e;| < k < 00. 

If (X,Y) is uniformly distributed on the rectanglea < 1 < b,0<y<a, 
where c; > g(x) + k, set 6, = c(b — a)Ny/N as in the hit or miss method. 
Similarly, set 62 = a (b-a) pu 1, 9(X;) as in the sample-mean method. Then both 





bi and 65 are unbiased and converge almost surely to J. Again, var 65 < < var 61. 


8.3.1.26 Weighted Monte-Carlo integration 


Estimate the integral J = fo of x) dx according to the following algorithm: 


1. Generate numbers {U,, U2,...,Un} from the uniform distribution on [0, 1). 
2. Arrange Uj, U2,..., Un in the increasing order U(), U(ay, .--, Ucn). 
N 
1 
3. Compute 63 = = So (9Uw) + g(U 41) )UG41) — Uy)|, where Uo) = 
i=0 
0, U(w41) = 1. This is an estimate of I. 


If g(x) has a continuous second derivative on [0, 1], then the estimator 03 satis- 
fies var 03 = E |(03 — I)?] < k/N*, where k is some positive constant. 
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8.3.2 NUMERICAL DIFFERENTIATION 
8.3.2.1 Derivative estimates 


Selected formulas to estimate the derivative of a function at a single point, with error 
terms, are given. Nodes are equally spaced with x; — x;_, = h; h may be positive 
or negative and, in the error formulas, € lies between the smallest and largest nodes. 
To shorten some of the formulas, f; is used to denote f(ao + jh) and some error 
formulas are expressed as O(h*). 


1. Two-point formula for f’ (29) 


f'(vo) = =(f (a0 +h) — f(¢0)) - 47). (8.3.12) 


This is called the forward-difference formula if h > 0 and the backward- 
difference formula if h < 0. 
2. Three-point formulas for f’ (ao) 





2 
# (a0) = 5-l-Bf(00) + 4f a0 + A) — flo + 2h)] + 2 FOE 
: re (8.3.13) 
= gilt (oo +h) — Feo — bY] - SFO). 


3. Four-point formula (or five uniformly spaced points) for f’(xo) 


4 
f'(eo) = orl — 8f14+ 8f1 — fa] + = 7) (€). (8.3.14) 


4. Five-point formula for f’ (29) 


f(a) = a 25 fo + 48/1 — 36f2 + 16fs— 3fa] + 716). (8.3.15) 


5. Formulas for the second derivative 


f"(00) = pola — 2fo + fal - Bh 


1 (8.3.16) 
= 72 lfo —2f1 + fol + * FE) — hf) (é). 
6. Formulas for the third derivative 
1 
f°) (eo) = 73 sa lJa— afa+3f1— fol + O(A), 
l (8.3.17) 
Sa [fo — 2f1 + 2f-1 — f-2] + O(h?). 
7. Formulas for the fourth derivative 
1 
f(a) = pala —4Afs+6fo—4fi + fo] + O(A), 
(8.3.18) 


= wilh —4fi + 6fo —4f-1+ f_2] + O(h?). 
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Richardson’s extrapolation can be applied to improve estimates. The error term of 
the formula must satisfy Equation (8.1.2) and an extrapolation procedure must be 
developed. As a special case, however, Equation (8.1.4) may be used when first- 
column entries are generated by Equation (8.3.13). 


8.3.2.2 Computational molecules 


A computational molecule is a graphical depiction of an approximate partial deriva- 
tive formula. The following computational molecules are for h = Ax = Ay: 


HO-@50}+0) (n2) 


(a) 





“al 


1) ere 





(2) = 








(d) 








Other molecules: 


O-O-O-2-O 
op? 


hv? 





Ox? 
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8.3.2.3. Numerical solution of differential equations 
Numerical methods to solve differential equations depend on whether small changes 
in the statement of the problem cause small changes in the solution. 


Definition — The initial value problem, 
dy 
a f(t,y), a<t<b, y(a)=a, (8.3.19) 
is said to be well-posed if 
1. A unique solution, y(t), to the problem exists. 
2. For any € > 0, there exists a positive constant k&(e) with the property that, whenever 
|éo| < € and 6(t) is continuous with |5(¢)| < € on [a, b], a unique solution, z(t), to the 
problem, 


< =. eR, alich eae ee, 
t) 


exists and satisfies |z(t) — y(t)| < k(e)e, foralla <t <b. 


This is called the perturbed problem associated with the original problem. Al- 
though other criteria exist, the following result gives conditions that are easy to check 
to guarantee that a problem is well-posed. 


THEOREM 8.3.1 (Well-posed condition) 


Suppose that f and f, (its first partial derivative with respect to y) are continuous for 
t in [a, b]. Then the initial value problem given by Equation (8.3.19) is well-posed. 


Using Taylor’s theorem, numerical methods for solving the well-posed, first- 
order differential equation given by Equation (8.3.19) can be derived. Using equally- 
spaced mesh points t; = a + th (for? = 0,1,2,...,.N) and w; to denote an approx- 
imation to y; = y(t;), then methods generally use difference equations of the form 


Wo = a, Win = Ww; + holt, wi), 


for eachi = 0,1,2,..., N —1. Here ¢ is a function depending on f. The difference 
method has local truncation error given by 


Ti41(h) = es P(ti, ya), 


h 
for each 2 = 0,1,2,...,.N — 1. The following formulas are called Taylor methods. 
Each has local truncation error 
h” 
fe () (. )) ey (+1) (¢. 5 


for each i = 0,1,2,..., N — 1, where €; € (t;,t;41). Thus, if y € C"**[a, b] the 
local truncation error is O(h”). 


1. Euler’s method (n = 1): 


Wisi = Wi + hf (ti, Wi). (8.3.20) 
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. Taylor method of order n: 


Wig1 = Wi + AT (E;, Wi), (8.3.21) 


where T) (t;, wi) = f(ti, wi) + Sf" (ti, wi) +... + apy, Wi). 
The Runge-Kutta methods below are derived from the n' degree Taylor poly- 
nomial in two variables. 


. Midpoint method: 


wig. = wi thf (t+ 4,wi + Sf (ti, wi))]- (8.3.22) 


If all second-order partial derivatives of f are bounded, this method has local 
truncation error O(h), as do the following two methods. 


. Modified Euler method: 


. Heun’s method: 


2 


2 


h 
Witt = Wet A {F(t a) +3f [s = 


. Runge-Kutta method of order four: 


1 
Wi4+1 = Wi + g (mt + 2ko + 2k + ka), (8.3.24) 


where 








ka =hf (ti41, wi + ka). 


The local truncation error is O(h*) if the solution y(t) has five continuous 
derivatives. 
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8.3.2.4 Multistep methods and predictor-corrector methods 


A multistep method is a technique whose difference equation to compute w;+ 1 in- 
volves more prior values than just w;. An explicit method is one in which the com- 
putation of w;+1 does not depend on f(t;41, wi+1) whereas an implicit method does 
involve f(t;41, wi+1). For each formula, i =n —1,n,...,N—1. 


8.3.2.5 Adams—Bashforth n-step (explicit) methods 
1. (n=2): wo =a, Wy = O41, Wid, = WE+ 413 f (ti, wi) — f(ti-1, wi-1)]. 
The local truncation error is 7341(h) = Sy? (1;)h?, 
for some 4; € (tj-1, ti41). 
2. (n=3): wo =a, WwW = 1, W2 = Q2, 
Wi41 = Wit + [23f (ti, wi) _ 16f (ti-1, Wi-1) + 5f (ti-2, Wi-2)]- 
The local truncation error is 7)41(h) = 3y (y:)h3, 
for some pi; € (ti—2, ti41). 


3.(n = 4): wo = a, Wr = Q1, W2 = AQ, WZ = 43, Wit. = Wi + 
37/55 f (ti, wi) — 59f (tir, wi-1) + 37f (ti—2, Wi_2) — Of (ti-3, Wi-3))- 
The local truncation error is 7;+)(h) = Bh yO) (ui )h4, 


for some pi; € (t;~3, ti41). 


8.3.2.6 Adams—Moulton n-step (implicit) methods 
1. m=2): wo =a, Ww, = a1, 
Wit. = Wit ADS (tizt, wir) + Bf (te, wi) — f i215 wi-1)]. 
The local truncation error is 7;41(h) = —yy (wi )h>, 
for some 4; € (tj-1, ti41). 
2. (n=3): Wo =, Wi = 1, We = A2, Wi41 = Wi + 4 [9f (tit1, Wi41) + 
19 f(t, 0%) — Sf G1, Wier) +f G2, Wi-2)). 
The local truncation error is 7;41(h) = — ay (u;)h*, 
for some pu; € (t;~2, ti41). 
3. (n=4): wo =a, Wy = Q1, Wo = A2, W3 = Q3, 
Wig = wi + AG 2D1S (tigi, wi41) + 646 f (ti, wi) — 264f (ti—1, wi-1) 
+106 f (t;2, wi-2) — 19f (ti_3, wi_3)]. 
The local truncation error is 7;4.1(h) = — oy (ui)h®, 
for some pi; € (t;~3, ti41). 





In practice, implicit methods are not used by themselves. They are used to improve 
approximations obtained by explicit methods. An explicit method predicts an ap- 
proximation and the implicit method corrects this prediction. The combination is 
called a predictor-corrector method. For example, the Adams—Bashforth method 
with n = 4 might be used with the Adams—Moulton method with n = 3 since both 
have comparable errors. Initial values may be computed, say, by the Runge-Kutta 
method of order four, Equation (8.3.24). 
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8.3.2.7 Higher-order differential equations and systems 


A system of m first-order initial value problems can be expressed in the form 





du 
Gp = falta, uas--+4%4m); ui(a) = a1, 
du 
aE = fo(t,ui1,U2,---,Um), u2(a) = ae, 
(8.3.25) 
dum 
7 Fm(E, U1, U2,.--;Um), Um(@) = Am. 


Generalizations of methods for solving first-order equations can be used to solve 
such systems. An example here uses the Runge-Kutta method of order four. 

Partition [a,b] as before, and let w;,; denote the approximation to u;(t;) for 
j = 0,1,...,N andi = 1,2,...,m. For the initial conditions, set wi19 = a1, 
W2,0 = Q2,..-, Wm,o = Am. From the values {w1,;, we,j;, ..., Wm,7} previously 
computed, obtain {wi ,j;+1, W2,j41,---» Wm,j+1} from 


Big = Af by Wi gs Wages, Dmg) 


h 1 i 1 
koi = hfi (+ +=,W1,5 + ght 2,3 + 5 h,23 seg Upaag HP sham) ; 








2 
h 1 1 i 
k3i = hfi (« + 5 UL + 3 kat) W2,4 + a k2.2, 605 Wing SF sham) ; 


kay = hfi (tj +h, wry +k, we, + k32,.--,Wmj + k3,m); 





1 
Wi jt) = Wig + rae + 2ko,i + 2k3,i + kaj), Roe®) 


where i = 1,2,...,m for each of the above. 
A differential equation of high order can be converted into a system of first-order 
equations. Suppose that a single differential equation has the form 


y™ = flityyiy”,--,yr), a<t<b ($327) 


=ay,...,y"—) (a) = am. All derivatives 
are with respect to t. That is, y‘”) = Ge: Define u(t) = y(t), ua(t) = y(t), ..., 
Um(t) = y(t). This yields first-order equations 


with initial conditions y(a) = ay, y'(a) 
da® 


du dug dum—1 dum f(t ) 
— =u — =u cits = Um, = f(t, uy, U2,...,Um), 
di 25 dt 35 Gi m dt 1,42 m 


(8.3.28) 








with initial conditions u;(a) = a1,..., Um(@) = Am. 
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8.3.2.8 Partial differential equations 


To develop difference equations for partial differential equations, one needs to esti- 
mate the partial derivatives of a function, say, u(x, y). For example, 


h,y) - h 0? 
Bu gy) = Meth Ue) ROWED tree (ath) 63.29) 
Pu ae h? d*u(E, y) 
Bq2 tr ¥) = 72 lulz +h,y) — 2u(a,y) + u(a@ — h,y)] - 72 det? (8.3.30) 


for € € (wx —h,x +h). 


Notes: 

1. Equation (8.3.29) is simply Equation (8.3.12) applied to estimate the partial 
derivative. It is given here to emphasize its application for forming differ- 
ence equations for partial differential equations. A similar formula applies for 
Ou/Oy, and others could follow from the formulas in Section 8.3.2.1. 

2. An estimate of 0?u/Oy? is similar. A formula for 0?u/Oxdy could be given. 
However, in practice, a change of variables is generally used to eliminate this 
mixed second partial derivative from the problem. 


If a partial differential equation involves partial derivatives with respect to only one 
of the variables, the methods described for ordinary differential equations can be 
used. If, however, the equation involves partial derivatives with respect to both vari- 
ables, the approximation of the partial derivatives require increments in both vari- 
ables. The corresponding difference equations form a system of linear equations that 
must be solved. 

Three specific forms of partial differential equations with popular methods of 
solution are given. The domains are assumed to be rectangular. 


8.3.2.9 Wave equation 


The wave equation is an example of a hyperbolic partial differential equation and has 
the form 


er (eit) — oP F(a, t) = 0, O<ax<£, t>0. (8.3.31) 


(where a is aconstant) subject to u(0, t) = u(é,t) = O fort > 0, and u(x, 0) = f(x) 
0 
and Spt 0) = g(x) for0 <x <8. 


Select an integer m > 0, time-step size k > 0, and using h = ¢/m, mesh 
points (#;,t;) are defined by x; = ih andt; = jk. Using w;,; to represent an 
approximation of u(z;,t;) and \ = ak/h, the difference equation becomes 


Wijt = 2(1 — A7)wi,g + AP (wig + Wi-1, J) — Wig-1, 
with wo,; = Wm,j = O and wio = f(a:), fori =1,...,m—landj = 1,2,.... 


Also needed is an estimate for w;.1, foreach i = 1,...,m—1, which can be written 


§ Se a | 
Wi,1 =(1 A ila) + 2 f (tins) + 5) f(i-1) + kg(zi). 
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The local truncation error of the method is O(h? + k?) but the method is extremely 
accurate if the true solution is infinitely differentiable. For the method to be stable, 
it is necessary that \ < 1. 


8.3.2.10 Poisson equation 


The Poisson equation is an elliptic partial differential equation that has the form 


O7u Oru 


V?u(z,y) = aan try) + ape) = f(x,y) (8.3.32) 


for (wy) € R= {(a,y)|a<a<be<y < d}, with u(xz,y) = g(x,y) for 
(x,y) € S, where S = OR. When the function f(x,y) = 0 the equation is called 
Laplace’s equation. 

To begin, partition [a,b] and [c,d] by choosing integers n and m, define step 
sizes h = (b—a)/n and k = (d—c)/m, and set x; = a + ih fori = 0,1,...,n 
and y; =c+ jk for j =0,1,...,m. The lines x = x;, y = y;, are called grid lines 
and their intersections are called mesh points. Estimates w;,; for u(x;, y;) can be 
generated using Equation (8.3.30) to estimate Ou and a The method described 
here is called the finite-difference method. 

Start with the values 


Wwo,j = g(o, Ys) Wnj = g(n, Uy)s Wi,0 = G(X, Yo); Wim = g(a, ia) 
(8.3.33) 


and then solve the resulting system of linear algebraic equations 


[as 


a2 
ig — (Wigan g Hi1,3)— (7) (wi j41t+i,j-1) = —h? f (xi, 05) 





(8.3.34) 
for? = 1,2,...,n—1 andj = 1,2,...,m—1. The local truncation error is 
O(h? + k?). 

If the interior mesh points are labeled Pe = (xj, y;) and we = w;,; where 


€=i+(m—1-—j)(n—1), fori =1,2,...,n—1, andj = 1,2,...,m—1, then 
the two-dimensional array of values becomes a one-dimensional array. This results 
in a banded linear system. The case n = m = 4 yields ¢ = (n — 1)(m— 1) = 9. 
Using the relabeled grid points, fe = f(Pe), the equations at the points P; are 











Py: 4w, —wa-we = Wo3twia—h* fi, 
Py: 4we — W3-W1- W565 = 4 h? fo, 

ace 4w3—w2—-We = wag t+w3,4—h? fs, 
Py: 4w4 —W5-W1-WwW7 = WO,2 — h? fia, 

Ps: 4ws W6E W4 W2 Wg = 0-— h? fs, 

Pe: 4we —wW5—w3-W9 = wa2—h? fo, 

Pe: Aw7—we— we = Wo1t+wio —h’* fr, 
Ps: dwg —W9—W7—- Ws = wWe9—h* fe, 

Po: 4wo —wg—We = w3,0 + wai —h? fo, 





where the right-hand sides of the equations are obtained from the boundary condi- 
tions. 
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8.3.2.11 Heat or diffusion equation 


The heat, or diffusion, equation is a parabolic partial differential equation of the form 


2 
(0,2) = a? 40,0), O<ax<2%, t>0. (8.3.35) 
where u(0,t) = 0 = u(¢,t) = 0, fort > 0, and u(a,0) = f(x), forO << a < @. An 
efficient method for solving this type of equation is the Crank—Nicolson method. 

To apply the method, select an integer m > 0, set h = ¢/m, and select a time- 
step size k. Here x; = th, i = 0,...,mandt; = jk, 7 = 0,.... The difference 
equation is given by: 


Wi,j+1 — Wij 


k (8.3.36) 
_ o@ [wits — 2wig + Wi-1,j 4g eral = 2wi jt + Wi-19+1| _ g 
2 h? h? , 
and has local truncation error O(k? + h?). The difference equations can be rep- 
resented in the matrix form Aw9+)) = Bw), for each 7 = 0,1,2,..., where 
A = 07k/h?, w9) = (wij, we,j,---;Wm—1,j)*» and the matrices A and B are 
Ges 2 0 0 0 0 
-\/2 (14+) -d/2 OO 0 0 
0 -A/2 (+A) —A/2 0 0 
au} 0 ( =o G2) 0 0 
0 0 0 0 G40) 19 
0 0 0 0 —\/2 (142) 
(8.3.37) 
(l—d) 2 0 0 0 0 
n/2 (1-A)A/2 0 0 0 
0 2 (1-r) A/2 0 0 
ga) 0 0 2 (1-2) 0 0 
0 0 0 0 (1—d)-A/2 
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8.3.3 NUMERICAL SUMMATION 


A sum of the form e, f (ao +jh) (n may be infinite) can be approximated by the 
Euler—MacLaurin sum formula, 


n 1 xotnh 1 
Di fleo+ sn) =— fF) dy + 5UF Gao + nh) + F(a) 
j=0 xo 


m 


+ BE HFM (29 + mh) — FMW) + Em 83.38 
k=1 : 





where FE, = ah ean f2m42) (€), with vo < € < aq + nh. The B,, here are 
Bernoulli numbers (see Section 1.3.5). 

The above formula is useful even when n is infinite, although the error can no 
longer be expressed in this form. A useful error estimate (which also holds when n 
is finite) is that the error is less than the magnitude of the first neglected term in the 
summation on the second line of Equation (8.3.38) if f(?""*+?) (a) and f?™+4) (x) do 
not change sign and are of the same sign for vq < « < % + nh. If just fOmr?)( 2) 
does not change sign in the interval, then the error is less than twice the first neglected 
term. 

Quadrature formulas result from Equation (8.3.38) using estimates for the 
derivatives. 





8.4 PROGRAMMING TECHNIQUES 


Efficiency and accuracy are the goals when solving a problem numerically. Below 
are suggestions to consider when developing algorithms and computer programs. 


1. Every algorithm must have an effective stopping rule. For example, loops 
should have an upper bound on the number of iterations. 

2. Avoid the use of arrays whenever possible. For example, sometimes the same 
variables can be over-written. 

3. Avoid using formulae that may be highly susceptible to round off error. For 
example, subtracting two numbers of similar size may reduce accuracy. 

4. Alter iteration formulae to improve accuracy. For example, roundoff errors 
may be reduced if a “small correction” is added to an approximation. 

5. Use pivoting strategies. These are recommended when solving linear systems 
to reduce round-off error. 

6. Eliminate unnecessary steps that increase execution time or round-off error. 

7. Combine numerical methods for efficiency. For example, use a weaker but 
reliable method to get near a solution, then use a stronger method to obtain 
rapid convergence. 
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9.1 ACOUSTICS 


Notation 

e A total absorption (m7?) e 7’ sound duration 
e aside of rectangular waveguide e v velocity (v= V@) 
e bside of rectangular waveguide e V room volume (m°) 
e csound speed (c = /® e W width of a room 
e FH height of a room ais pe oa 

F e p density 
e LI length of a room or organ pipe f 

e ¢ potential 
e P pressure i 
__ Cp __ specific heat at constant pressure ;,, : : 

2 = a ~~ specific heat at constant volume (© 1.4 in air) 


With the following assumptions 

1. The medium is a Newtonian fluid, homogeneous, and at rest (that is, V = 0) 

dP 
2. The medium is an ideal, adiabatic, and reversible gas (that is, A = a 
p p 

3. There are no body forces and no viscous forces 
4. There are small disturbances (that is, the equations are about a steady state) 
5. There is irrotational flow (that is, V x v = 0) 


The acoustic wave equation is any one of the following 


PV on PP on Pb a9 
gn °C VV=9 a =e ge ° V e=0 
Equations 

1. Room modes (where p, g, and r can be 0,1, 2,...) 

C p\2 q \2 r\2 
wed fequeney = 5 (T) + (qr) + (q) 
supported frequency = 5 7 + W a Ti 
2. Cutoff frequency (rectangular waveguide, m and n are mode numbers) 


nT \ 2 mT \ 2 
Vf @ 
a b 
: , V 
3. Sabine’s Reverberation Formula T= eT 
4. Organ pipes 
(a) open at one end and closed at one end 
i. fundamental frequency n, = c/4L 
ii. first overtone (third harmonic) n3 = 3c/4L = 3n1 
iii. second overtone (fifth harmonic) n5 = 5c/4L = 5ny4 
(b) open at both ends 
i. fundamental frequency n, = c/2L 


ii. first overtone (second harmonic) nz = c/L = 2n1 
iii. second overtone (third harmonic) n3 = 3c/2L = 3n, 
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9.2 ASTROPHYSICS 


Notation 

@ a semi-major axis e mmass 

e AU astronomical unit e M mean anomaly 

e 6 semi-minor axis e psemi-latus rectum 

e b brightness (%) e P orbital period 

e cspeed of light (~ 3 x 10° m/sec) e r distance 

e d distance to star in parsecs © Tmin perihelion 

e D proper distance ® Tmax aphelion 

e F eccentric anomaly e ¢ time since perihelion 

e G gravitational constant e v velocity 

e h angular momentum e © eccentricity 

e Ho Hubble’s constant e yu standard gravitational parameter 

e FL luminosity e @ true anomaly 
Equations 

1. Escape velocity v> ical 


Escape velocity from the Earth’s suiace is 11 km/s. 

Escape velocity from the solar system (from Earth) is 42 km/s. 
2. Hubble’s law v = HoD 
3. Kepler’s equation M=E-esinE 
4. Kepler’s laws 


(a) The orbit of every planet is an ellipse with the Sun at one of the two foci. 
- Pp 
a +e cosé 
(b) A line joining a planet and the Sun sweeps out equal areas during equal 
intervals of time. [Equivalently, angular momentum is conserved. ] 


d {1 4; 
— (50) = h? = G(m1 + m2) p 


(c) The square of the orbital period of a planet is directly proportional to the 
cube of the semi-major axis of its orbit. 
2 


2 
lanet 
pales constant = —— 
m 


3 
planet 


5. Luminosity L =4nd?b 
6. Magnitude of a star 


d 
(apparent magnitude) — (absolute magnitude) = 5 logy, (=) 


Ts 


11. 
12. 


Orbital period 
one large mass P=2t4 
two masses P=27 





. Relations 
en Pp 
1-é 
Tmin = = 
l+e 
2at 
M= > 


= Tmax — Tmin 


Tmax + Tmin 


. Rocket equation 
. Schwarzschild radius 


Vis-viva equation (elliptic orbits) 
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a3 
Gm 
a3 
G(m, + M2) 
For the solar system P = Va? years, when a is in astronomical units (AU). 
P 
b= =Gm 
vl-é e 
: Sa 
max 1 =<€ 
0 l+e E 
t -= oF —— 
on = estan (5) 
1 1 1 1 
Tmin P P Tmax 
_ [{ Minitial 
VUfinal = Vexhaust log = 
G ™Mfinal 
2Gm 
Rscn = —z 
2 1 
v? = G(m, + m2) (; - +) 
roa 


Numerical parameters 
e AU 


149,597,870.7 km or 92,955,807.27 miles 


e G (gravitational constant) 6.67428 x 10-4 Nae 


e Sun 
— mass 
— mean radius 
— HB 
e Earth 
— eccentricity 
— mass 
— mean radius 
— orbital period 
— semi-major axis 
e Moon 
— eccentricity 
— mass 
— mean radius 


— orbital period 
— semi-major axis 


1.9889 x 10° kg 
696,000 km 
132,712,440,018 km3s~2 


0.016710219 
5.9736 x 1024 kg 
6,367.454 km 
365.256366 days 
149,597,887.5 km 


0.0549 
7.3477 x 1022 kg 
1,737.10 km 
27.321582 days 
384,399 km 
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9.3 ATMOSPHERIC PHYSICS 


Notation 
e aacceleration e TR temperature (°R) 
e D density (kg/m?) e v velocity 
e DA density altitude (feet) e z altitude 
e FR gas constant e 7+ lapse rate 
e RH relative humidity e © earth rotation rate 
e T temperature (°K) 
e To temperature (°C) 
e fF, saturation pressure of water vapor (mb) 
e FP total air pressure (P = Py + Py) 
e P4 station pressure (inches Hg) 
e FP, pressure of dry air (partial pressure in Pascals) 
e P, pressure of water vapor (partial pressure in Pascals) 
e Raq gas constant for dry air, 287.05 J/(kg °K) 
e f, gas constant for water vapor, 461.495 J/(kg °K) 
Equations 
1. Coriolis effect a=-20xv 


2. Density (approximation) 


P Pi P, Pi P, 
D=— = —_—— = ee 1=0, — 
RT (4) r (4) (4) ( ae =) 


3. Density altitude (approximation) 


17.328P,\°"" 
TR 





DA = 145442.16 (: = ( 


dT 
4. Lapse rate y=-— 


dz 
The dry adiabatic lapse rate (DALR) is 9.8°C/km 


5. Saturation pressure (approximation) 
E, = 6.1078 x 107-5 Tc /(237.3+Tc) 


6. Vapor pressure 


(a) PP =E, at the dew point 
(b) Py = RHE, otherwise 
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9.4 ATOMIC PHYSICS 





Notation 
e F energy e m principal quantum number 
e e charge e r radius 
e fh Planck constant e v velocity 
e LF angular momentum e \ wavelength 
e m mass e w frequency 
e cspeed of light (~ 3 x 10° m/sec) 
e hreduced Planck constant (h = # ~ 10~*4 J-s) 
e & Coloumb’s constant ~ 9 x 10° N m? C~? ae 
e FR Rydberg constant for electron energy (mE ew x= 13. 6 eV) 
e R) Rydberg constant for reciprocal wavelength (ae y = 10° m—*) 
1. Bohr model 
(a) angular momentum Lyn = nh 


(b) radiation/absorption of energy hw = E, — Em 











. Hydrogen atom 
muzike? ke? R 
(a) energy En = i = = =—5 
1 1 1 
(b) radiation spectrum ri = Ry (—— = —-) 
initial final 


for transitions between states. This is the Lyman series (nina = 1), 
the Balmer series (Mfna1 = 2), and the Paschen series (Nina = 3). 








nh? 
di 1, = — 
(c) radius r rhea 
h? é 
(d) Bohr radius a=T1= + =0.53A 
mke? 
: ke 
(e) velocity Un = — 
nh 
9.4.1 RADIOACTIVITY 
e A radioactive sample activity e T\/2 half-life 
e N number of intact nuclei e decay constant 
e ¢time ay e 7 mean lifetime 
1. Governing equation — =— dt 
In2 _ 0.693 
2. Half-lif Tyj2 = = 
alr-hite i ee X 
3. Radioactive decay law N = Noe 
4. Mean lifetime T= the dp = = OL 
A In2 
eer = aN 
5. Radioactive sample activity A= = XN = Age” 


“dt 


696 





CHAPTER 9. MATHEMATICAL FORMULAS FROM THE SCIENCES 


9.5 BASIC MECHANICS 





Notation 
e a,a acceleration e m mass e v,Vv velocity 
e Aarea e M moment e V volume 
e ddistance e p,p momentum e V potential 
e FF force e P pressure e W work 
e J moment of inertia e r,r distance e x position 
e k spring constant e s speed e w angular velocity 
e L angular momentum e T period e p density 
e 7 torque 
e cspeed of light (~ 3 x 10° m/sec) 
e g acceleration due to gravity (~ 9.83) 
e G gravitational constant (+ 6.67 x 10-U Aa ) 
e a angular acceleration 
e x coefficient of kinetic friction 
e is coefficient of static friction 
e @ angular displacement 
Equations 

1. Angular momemtum L=rxp_ and a =M=rxF 
2. Center of mass Xo = aT with M = $0 ,m; 
3. Conservative force 

(a) F=VV 

(b) (kinetic energy) + (potential energy) = (constant) 
4. Density p= a 
5. Friction 

(a) static friction Picton S Ls Paotmal 

(b) kinetic friction Friction = Lk Formal 
6. Gravitational force F= epi 

= 

7. Hooke’s law (Ax = displacement from equilibrium) F=-kAg 
8. Inclined plane (0 is angle between inclined plane and horizontal) 

(a) Fhormal = mg COs 0 

(b) Fnctine = mg sin 6 
9. Kinetic energy 


linear = 5m 


1 
rotational = - w 


1 1 
rotational, without slipping = 5m + a w? 
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10. Moment M=rxF 

11. Momentum p=mv and p=mvy 

12. Newton’s laws 
(a) first law: in equilibrium, > F = 0 and Telockwise = Tcounter-clockwise 
(b) second law: F=ma 


[L 
13. Pendulum (L = length of pendulum) T= 27,/— 
g 


14. Period of simple harmonic motion T = 274/ = 


F 
15. P P= — 
ressure A 


1 th of stri t i in stri 
(6 Siesdiraweadence ee) 
(mass of string) 


17. Springs F(t) = k(x(t) — xo) 
18. Torque (/ = lever arm length) T=FI 
19. Work W =Fd 


20. Equations of circular motion 
(a) Angular speed v=Tw 


(b) Centripetal acceleration and force (constant speeds v, w, radius R) 


v? v2 


a= p=wR Fama = mw R 


(c) Circular motion (constant acceleration) 
Ww =Wo tat 


1 
G= A al Wot + aa 


1 
6=4+wt — sat? 


4 





1 
0 = 80 + 5 (w +u0)t 
w? = we + 2a(0 — 4) 


21. Equations of linear motion 
d 
(a) Average speed v= . 
(b) Free fall (from rest and a height of h) v= /2gh 
(c) Linear motion (constant acceleration) 


v=vo + at 


13 
C= 25 Puget 5 at 


v? =v +.a(2 — 20) 
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9.6 BEAM DYNAMICS 


F Young’s modulus 
I moment of inertia 
K length factor 

I length of column 

M bending moment 
Q shear force 


1. Static one-dimension beam equation 


q applied loading 

w beam displacement 
& curvature 

@ slope of the beam 
o bending stress 


2. Derivable quantities 


Bending moment 


Shear force 
Slope 


Strain 


Bending stress (with symmetry) 


3. Boundary conditions 


is clamped 
is free 


has a point force 
has a point torque 


4. Boundary conditions 


e is clamped 


e 
e 
e is simply supported 
e 
e 


dw 
M = EI— 
dx? 
— dM da (dw 
~ dr dx dx? 
dw 
er) 
dw 
és = —ZK=—2Z 
dx? 
_ Mz _ Pw 
ge dx? 


The end x = z of the beam... 
w(z) = given and w'(z) = given 
w"(z) = Oand w""(z) =0 
w"(z) = 0 and w(z) = given 
w"(z) = Oand w'"(z) = given 
w'"(z) =O and w"(z) = given 
The internal point x = z of the beam... 


w(z—) = w(z+) = given, w’(z—) = w’(z+) = given 


e is simply supported 


w(z—) = w(z+) = given, w’(z—) = w'(z+), 
e has a point force 








(2—) 
w" (z-) = w" (z+), w!"(z—-) = w"" (z+) = given 
e has a point torque w(z—-) = w(zt+), w'(z-) = w'(z4), 
w"(z—-) = w" (z+) = given, w"(z—) = w"" (z+) 
5. Buckli f col itical buckling f wa 
. Buckling of columns critical buckling force = (KL 
ekK=1 if both ends pinned 
e k=0.5 if both ends fixed 
e Kk =0.699 if one end fixed, one end pinned 
ek=2 if one end fixed, one end moves laterally 
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9.7 BIOLOGICAL MODELS 


1. Population growth - discrete Let N,,, be the number of individuals in gen- 
eration m and q be the number of offspring per parent per generation. Then 


Nm = Noq™ (9.7.1) 


2. Population growth - continuous Let N(t) be the population at time t, r 
be the growth rate, and Kv be the maximum population size. 


dN 

—=rN exponential growth model 

dt (9.7.2) 
dN N(K -—N) iste eesedal 

— = 7-— ogistic growth mode 

a" «K aaa 


3. Population growth — Renewal equations Let n(t, «) be the number of in- 
dividuals at time t of age x and B(x) be the birth rate from individuals of 
age x. The equations modeling population size are: 


0 0 
wt ae 70 fort >0,x>0 
— (9.7.3) 
n(e=0)= | Bey)n(t.y) dy 
0 
4. SIR Epidemic model 
e S(t) number of susceptible individuals at time ¢ 
e I(t) number of infected individuals at time ¢ 
e R(t) number of recovered (and immune) individuals at time t 
e N=I1+R+S is the total population 
e £ is the contact rate 
e y is the reciprocal of period that an individual is infectious 
The equations modeling population health are: 
dS IS 
a PN 
dI Is 
— = B——_yI 9.7.4 
a PN one 
dS 
— =! 
dt) 


The expected number of new infections, from a single infected individual in a 
population of all susceptibles, is Ro = 3/7 (“basic reproduction number”). If 
e Ro > N/S(0) then I’(0) > 0 and there will be an epidemic. 
e Ro < N/S(0) then I’(0) < 0 and there will not be an epidemic. 


There are variations of the SIR model that include, for example: birth and 
death rates, no immunity (e.g., common cold), and having incubation periods. 


700 


CHAPTER 9. MATHEMATICAL FORMULAS FROM THE SCIENCES 





9.8 CHEMISTRY 


See atomic physics (page 695), temperature 


(page 724). 


7 van ’t Hoff factor 

Kq equilibrium — weak acid 
Ky equilibrium — weak base 
kK, equilibrium — gas pressure 


JX, equilibrium — molar concentration 


(page 795), and thermodynamics 


nm amount of substance (in moles) 
P pressure 

T temperature 

V volume 

[ ] molar concentration 


ky ebullioscopic constant (for water: 0.512 °K-kg/mol) 
Kr cryoscopic constant (for water: 1.853 °K-kg/mol) 


R ideal gas constant (8.31 J/mol-°K) 
. Equilibrium 
__ [products] — [C]°[D} 


7 [reactants] - 


- 


K, = 


Preactants 
. Equilibrium — Acids and Bases 
[H*}[A7] 
[HA 
[OH~ |[HB*] 
[B) 


ky= 
. Gases 
(a) Ideal gas law 
(b) Boyle’s law 
(c) Charles’ law 
(d) Avogadro’s law 
(e) Dalton’s law 


1 
Pay 
VaT 
Van 


. Solutions 
Molacitya) = moles of solute 
ues ~~ liters of solution 
. Other 


(a) Freezing point depression 
(b) Boiling point elevation 
(c) Kinetic energy per mole 


(d) Rate equation — zero order 


(e) Rate equation — first order 


Products _ (Pco)* (Pp)* 
(Pa)* (Pp)" 


where aA + OB = cC+dD 


pH = — log[H*] 
pOH = — log/OH | 
pH + pOH = 14 


PV =nRT 


Potal =Ppit-+-+Dn 
where Px = Potal ce 


oles X 


al moles |S the partial presure 


= moles of solute 


molality(m) = “ke of salvent 
ATr = Krpmi 
3RT 
all =f [A] = [A]o — kt 
aA — —k[A] — In[A] = InfA]o — kt 
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9.9 CLASSICAL MECHANICS 


e H Hamiltonian e T temperature 
e J action variable e U potential energy 
e K kinetic energy e @; action angle 
e L Lagrangian e p probability density 
e p generalized momentum e {, } Poisson bracket 
e q generalized coordinate 
Equations 

dé; OH 

1. Action angle evolution (for periodic motion) a ae 


2. Action variable (for periodic motion) 


20 
nas pp: dq; = ) ( Fe) at 

















3. Generalized momentum p= — 
4. Gibb’s distribution (p,q) = poe 20/7 
5. Hamiltonian H(p,q) =K+U=-L+)_ pid 
OH OH 
6. Hamilton’s equations of motion Gi = ; p= 
Opi Ogi 
7. Lagrangian L(q,q) =K —U 
. os OL OL 
8. Lagrange’s equations — =0 
OG (Ogi 
9. Time evolution (of any function . (p,q, t)) 
df _ of of 1, + —D; 
dt — Ot Od; a Opie 
0 Of OH Of OH f 
= oF 4 fH 





~ Ot" OG. Opi Opi OG, OE 
10. Liouville’s theorem: For a probability distribution p = p(p, q) 


dp. __ Op 





dt 
EXAMPLES 
1. Consider a falling mass m. The kinetic energy is kK = dmv" = 4mz?. The potential 
energy is U = —mgz. The Lagrangian is L = K -U = smx” mga. 
: q = x then g = &andp = oh = _ = ma. Lagrangian’s equations become 





Ou Ox dt 
2. If two equal point masses (m) are connected by a spring (with spring constant k) of 
length @, then LD = 2 m (a7 + £3) = £ (a1 —%2— £)?. 
3. If a pendulum (iiacaless rigid stick of length @) with a point mass (m) at the end is 
swinging due to gravity (g), and @ is the angle between the stick and the vertical, then 
i= m0?6? + mgécos 0. 


OL OL d 3 . 
—(|—)}- (m&) — mg = mz — mg = 0 or % = g, as expected. 
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9.10 COORDINATE SYSTEMS — ASTRONOMICAL 


Notation 
e aaltitude e aright ascension 
e A azimuth e 6 ecliptic latitude 
e b galactic latitude e 6 declination 
e H hour angle (HW = LST — a) e ¢ Earth’s axial tilt (« © 23.4°) 
e | galactic longitude e A ecliptic longitude 
e LST local sidereal time e ¢ geographic latitude 
e @ zenith (9 = 90° — a) 


Relations 
1. Ecliptic coordinates to equatorial coordinates (a, 0) 
sind = sinesin A cos 6 + cosesin 3 
cos acos dé = cos A cos 
sina cos é = cosesin A cos 8 — sine sin 6 
2. Equatorial coordinates to ecliptic coordinates (3, ) 
sin 8 = cosesindé — sinacos 6 sin € 
cos cos 3 = cosa cos dé 
sin A cos 6 = sinesin dé + sin a cos 6 cose 
3. Equatorial coordinates to galactic coordinates (b, /) 
b = sin~' (cos 6d cos 27.4° cos(a — 192.25°) + sind sin 27.4°) 


4. Equatorial coordinates to horizontal coordinates (a, A) 


1 =tan! (sing - 


sina = sin@sind + cos ¢cos dé cos H = cosd 

cos dsin 6 — sin @ cos 6 cos H 

cos A = 
cos a 


5. Galactic coordinates to equatorial coordinates (a, 6) 
6 = sin‘ (cos bcos 27.4° sin(I — 33°) + sin bsin 27.4°) 


a =tan7! loa SSS) + 192.5° 
sin b cos 27.4° — cos b sin 27.4° — sin(J — 33°) 
6. Horizontal coordinates to equatorial coordinates (a, 0) 
sind = sindsina — cos@cosacos A 
cosécosH = cos@dsina+sin@cosacos A 


cos 6 sin H = —sin Acosa 
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9.11 COORDINATE SYSTEMS — TERRESTRIAL 


Notation 
e a semi-major axis e N radius of curvature in the prime 
e bsemi-minor axis vertical 
e e eccentricity e qa angular eccentricity 
e e’ second eccentricity e X longitude 
e f flattening e ¢ geodetic latitude 
e h height e ¢' geocentric latitude 


e ENU local (East, North, Up) coordinates 

e ECEF Earth-centered Earth-fixed coordinates 
e ECF same as ECEF 

e {X,,Y,, Z,} reference point for ENU (in ECEF) 








Relations 
a 
1. b=a(1—f) 5. N(¢) =§ ——= >= 
2 a—b V1-—sin* ¢sin“ a 
2.e° = 2 = f(2 ~~ f) = b 
a 5 6. @= cos — 
3. 2a 6 _ f@—f) a 
b? (1 rs 7. x =\/1—e?sin’ ¢. 
4 fat =n mall =) 
a 8. tang’ = gO tan 
Transformations xt 


1. ECEF coordinates to ENU coordinates (x, y, z) 


x — sin cos A 0 X — X, 
y| = |—sin@cosA —singsinA cosd| | Y —Y, 
Zz cos @ cos A cos¢sinA sing Z—Z, 


2. ENU coordinates to ECEF coordinates (X, Y, Z) 


xX —sinX —sing@cos\ cosdcosA| |x Xp 
Yi = cosA —singsinA cos@sinA; jy] + | Y; 
Z 0 cos @ sing z Zr 


3. Geodetic coordinates to ECEF coordinates (X, Y, Z) 
a a . 
X= (< +2) cos @ cos A eS (< +n) cos g@ sin » 
xX xX 
= 2 
i po 4 n) ain d 
x 


4. Geodetic coordinates to geocentric rectangular coordinates (X, Y, Z) 


X =(N+h)cos¢cos\ Y =(N+h)cos¢sinX Z = (Ncos* +h) sing 
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9.12 EARTHQUAKE ENGINEERING 


A maximum excursion of a Wood—Anderson seismograph 
Apo empirical function 

Eg radiated seismic energy 

Mo magnitude of the seismic moment (in dyne-centimeters) 
M. energy magnitude 

My local magnitude (Richter magnitude) 

My moment magnitude 

v velocity 

6 distance of seismograph to earthquake 

A first Lamé parameter 

pt Shear modulus 

p density 


Equations 


1. 


ND UU fF YW WN 


Magnitude 0 event: earthquake showing a maximum combined horizontal 
displacement of 1m (0.00004 in) on a Wood—Anderson torsion seismometer 
at a distance of 100 km from the earthquake epicenter. 


. Eg = 1.6 x 107° Mo 

. M. = $ logig Es — 2.9 

. My = logo A — logy) Ao(d) 

. My = 2 logig Mo — 10.7 

. Seismic moment = (Rigidity) x (Fault Area) x (Slip Length Area) 


. Speed of seismic waves 


— [A+2u [ph 
US-wave = UP-wave = = 
p p 


. Energy in earthquakes 


ys cI 
tT 


a mettic tons |____—2TT] 
6 | _Tkiotons [63 TT] 
[8 [15 megatons |___ 63 PI] 
[9 474 megatons | ____2 FT] 
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9.13 ECONOMICS (MACRO) 


C = Consumption e Q= Quantity 

E= Number of employed e S = Savings 

G = Government Spending e T= Taxes 

I= Investment e U=Number of Unemployed 
L = Labor force e X= Exports 

M = Imports e Y = Total Income 

P= Price e f= Rate of Job Finding 

POP = Adult population e s=Rate of Job Separation 


1. Consumption 


Ch in C ti 
(a) Marginal Propensity to Consume MPC = eee : saute ean 
Change in Income 


Ch in Savi 
(b) Marginal Propensity to Save MPS = 1 — MPC = pene’ 


(c) Price elasticity of demand (PED) 
% A quantitydemanded dQ/Q  PdQ 


Change in Income 





PED = =— —~* = _ 
% A price dP/P QdP 
(d) Spending multiplier Spending multiplier = 1/MPS 
(e) Tax multiplier Tax multiplier = MPC/MPS 
2. Employment 
(a) Labor force L=E+U 
(b) Labor force participation Labor force participation = L/POP 
(c) Steady state labor market sk = fU 
U s 

d) U l t rat U 1 trate = — = 

(d) Unemployment rate nemployment rate Coat 


3. Gross Domestic Product (GDP) 


(a) Nominal GDP (NGDP) 
i. Income Approach NGDP =C+S+T 
ii. Spending Approach NGDP = C+1I+G+ (X —M) 
—K——’ 





net exports 
(b) Real GDP (RGDP) RGDP = PiQi + P2Q2+ P3Q34+... 
(c) GDP deflator GDP deflator = SSPE x 100 

4. Inflation 
. price in specific year 
(a) Consumer Price Index (CPI) CPL = ————_——_ 
price in base year 

CPIney — CPI, 

(b) Inflation rate Inflation rate = ——“*—~——"_ x 100 


CPloia 
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. Interest rate 


1 + (Nominal interest rate) 


(a) Correct (Real interest rate) = 1 + inflation rate) 


(b) Fisher equation (approximation) 
(Real interest rate) = (Nominal interest rate) — (Inflation rate) 


. Profit Maximizing point Marginal Cost = Marginal Revenue 
. Saving 
(a) National saving National saving = Y—C—G 
(b) Private saving Private saving = Y — T—C 
(c) Public saving Public saving = T—G 
(d) Open economy Saving =I1+ X—M 
(e) Closed economy (no trade) Saving = 
. Time value of money Future value = Present value x (1 + Interest rate) 
. Wages (Change in real wage) = (Change in nominal wage) — Inflation 


9.13.1 DEPRECIATION 


There are many different, yet standard, ways to determine depreciation. For exam- 
ple, fora V = $100 asset with a lifetime of N = 3 or N = 5 years, the yearly 
depreciation (D), rounded to the nearest dollar, is: 





Lifetime of 5 years 





$ 


sas 
sa Fstz}- 390 | si) 


Lifetime of 3 years | SL | DD | SY 
| $40] $ 


es ee ee ae tess} sr} si} 





a (i (es 


where the depreciation methods are: 


1 
e Straight Line Depreciation (SL) D = Va for years y = 1,2,...,N 


N 


2 aay 
e Double Declining Depreciation (DD); D = Vay (=) for years 


e Sum of Year’s Digits (SYD); D = V 


N 


y =1,2,...,N — 1, with a remainder in year NV 


2(N+1-y) 


=~ for earsy = 1,2,...,N 
NNT oe 


e Modified Accelerated Cost Recovery System (MACRS); depreciation is given 


in the US Internal Revenue Service’s (IRS) publication 946. 
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9.14 ELECTROMAGNETIC TRANSMISSION 


9.14.1 ANTENNAS 


e A area of physical aperture G antenna gain 


e 
e BW antenna beamwidth in radians e L length of rectangular aperture 
e BW.,,z azimuth beamwidth e W width of rectangular aperture 
e BW, elevation beamwidth e » efficiency 
e dantenna diameter e \ wavelength 
Equations 
1. Parabolic antenna beamwidth (in degrees) BW = ita 
2. Antenna gain 
(a) idealized uniform antenna pattern 
area of sphere _ Ar 


area of antenna pattern BWazBWei 
4nnA 

2 
(c) rectangular X-band aperture (Z and W are in cm) G=1402W 


(d) circular X-band aperture (d is in cm) G=dn 


(b) real antenna pattern = 





9.14.2 WAVEGUIDES 


a dimension of waveguide (a > b) e r waveguide radius 

b dimension of waveguide e © permittivity of medium 

c speed of light in medium e «4 permeability of medium 

f. cutoff frequency (transmitted above and attenuated below this frequency) 
f?"” cutoff frequency for TE,,,, mode 

TE transverse electric mode (E-field orthogonal to axis of waveguide) 

TE,; TE mode with 7 and j wave oscillations in a and b directions (7, 7 > 0) 
TM transverse magnetic mode (H-field orthogonal to axis of waveguide) 
TM;; TM mode with i and j wave oscillations in a and 6 directions (2, 7 > 1) 


a Sagara 2. soe 2.4048 c 
1. Circular waveguide (TMo; mode) — 








2. Rectangular waveguide 


CT mn __ 
i= = nes = = ( - (ey 5 \/( 


EXAMPLE 


Rectangular waveguide (a = 2 cm, b = 1 cm) filled 7 2 
10 


TEo1, TE20 





with deionized water (42 = 1, € = 81) operating at 3 
GHz. Propagating modes and cutoff frequencies are: 


TEi1, TMi 
TE21, TMai 
TE30 
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9.15 ELECTROSTATICS AND MAGNETISM 








e B,B magnetic field ek= om ~9x 109 Nae 
e cspeed of light e q charge 
e D= «EF displacement vector e r separation 
e FE electric field e S Poynting vector 
e FF force e U potential energy 
e H= B/po — M magnetic field e ¢ dielectric constant 
e J current e p charge density 
e J current density e v,v velocity 
° fo = 40 x 10-7 
Equations 
1. Ampere’s law VX B= pod 
2. Biot-Savart law 
Idsxr 
(a) for a segment of wire ds dB = a ; 
T fT 
(b) at distance r from an infinitely long wire B = pol /27r 
(c) at the center of a loop of radius R B= pol /2R 
3. Coulomb law =KS? 
4. Densities 
(a) electric field energy density (E- D)/2 
(b) magnetic field energy density (B- H)/2 
(c) momentum density (E x B)/c? 
5. Electric field due to a point charge B= rt 
r 
6. Electric potential energy Uap 
r 
7. Force 
(a) in aconstant electric field F = qE 
(b) on a charge moving in a magnetic field F=qvxB 
(c) Lorentz force F = q(e+v xB) 
8. Gauss’ law V -E=p/e0 





dE gi? 
9. Larmor formula (energy loss of an accelerated charge) aE” ba 
TT C° EQ 


10. Maxwell’s equations (differential form) 


(a) V-B=0 ae (c) V -D = Pitee 
(b) VxE=-— (d) V X H= Jeree + = 


t 
11. Poynting vector 2 S=ExH 
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9.16 ELECTROMAGNETIC FIELD EQUATIONS 


Notation 
e A (vector) magnetic potential 


e B,B magnetic field 
e cspeed of light 
e FE, E electric field 


F stress-energy tensor 

J (vector) current density 
[io = 4m Xx j= 

@ (scalar) electric potential 


p (scalar) charge density 
We have B = V x A and E = —V¢é — 1K. The electromagnetic four-potential is 


the one-form A” = [4 Al and the electromagnetic stress-energy tensor 
1. is a covariant antisymmetric tensor 


2. is the exterior derivative F = dA 
3. is, in component form, F4“” = 0" A” — 0” A¥ or Fry = OnAy — OVAp 


where 0” = x = [+2 -V] . The contravariant form (F'"”) and the covariant 
form (Fy, = Nua lng) for the metric tensor 7,4 = diag(1, 1, —1, —1) are 
0 —fe fy _E 0 Ex Ey Ez 
E c c Cc E c ce Cc 
=2 0 -B, B —=2£ 0 -B B 
pee = ies y F. p= « ¥ 
By B, 0 —-B, . 4a By 0 —-B, 
4 -B, B, 0 -&2 -B, B. 0 
(9.16.1) 
The electromagnetic four-current is J” = [cp J] (note that 0, J* = 0) and 
Maxwell’s equations are 
Og FO’ _ vad” 
(9.16.2) 


Or pe +4 ou pyr 4 QO’ PX —0 
Notes 
1. The meaning of “gauge invariance” is this: if A is changed by the gradient of 
a scalar field A (that is, A + A + VA) then Equation (9.16.2) is unchanged. 
2. The Lorenz gauge condition is 0, A° = 0. 
3. The electromagnetic force on a particle with charge q is: 


Force = q(E+ v x B) = qF#’u"" 


where the four vector velocity is u4” = [c Ug Uy tip) 

4. Transforming the field strength tensor to a different inertial frame is accom- 
plished by: F = FY’ = LEU! = LHL’ Fe 
where L is the Lorentz transformation tensor: 


y — Bx , —7By —Bz 
-7B, 1+ oo a a 








4 = 2 4 
— By ee 1+ y eo — 
— = 2 
-~7B. a y aa ie y ae 


and 8 = v/c, 8? = |B|?, and y = 1//1—B8- 8B 
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9.17 ELECTRONIC CIRCUITS 


e Aarea e FL inductance e V voltage 

e C' capacitance e P power e Z impedance 
e ddistance e Q charge e w frequency 
e J current e R resistance e presistivity 


© €) © 8.85 x 10-?= 
e « dielectric constant 














Equations 
1. Ohm’slaw V=I/R 
y2 Ves 
2. Electric power P= IV =/°R= R Prverage = Tins = R 
3. Kirchhoff’s laws . 
(a) Loop tule Saou any loop AV; =0 
(b) Noderule )°., any node Li = 0 : ; 
4. RMS values (for AC circuits) Vins = 2s, Tnms = 
v2 v2 
5. Resistors 
(a) Adding in series Rs =Ri +Ro+R34+... 
. 1 1 1 
(b) Adding in parallel Hs = R, ea pa aa ie eee 
(c) Resistance of a wire of length L and cross-sectional area A R= ae 
6. Capacitors 1 1 1 1 
(a) Adding in series Gs G +— Cp + ct +... 
(b) Adding in parallel Cp=Cy+C24+ 03+. 
(c) Capacitance C= V 
seg A 
(d) Capacitance of a parallel plate capacitor C= “ 
dV (t 
(e) Current across a capacitor I(t) = <3 
. . oe 1Q? 
(f) Energy stored in a capacitor = sor = = = 5QV = = Sat 
7. Inductor (inductors add with the same ean as that for resistors) 
dI(t 
(a) Voltage across an inductor V(t) = ato 


1 
(b) Energy stored in an inductor = 5lt : 


8. Impedance (impedances add with the same formulas as that for resistors) 
(a) Ideal resistor ZRe=R 
(b) Ideal inductor Zr = iwl 
1 


(c) Ideal capacitor Zo = 
iwC 
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9.18 EPIDEMIOLOGY 


Notation 
e F'N False negative e PV predictive value 
e F'P False positive e TN True negative 
e LR likelihood ratio e TP True positive 
Equations 


1. Operating characteristics 


Disease 
Yes No 


Meets case definition Yes | True positive (J’P) | False positive (FP) 
No | False negative (F'NV) | True negative (T'V) 





TP 
(a) Sensitivity = Prob (T+ | D+) TP+FN 

TN 
(b) Specificity rob ( | ) TN+FP 
(c) False positive rate = Prob (T+ | D-) = —*~ 
c) False positive rate = Pro = TNaEFP 

FN 

(d) False negative rate = Prob (T— | D+) = TPLFEN 





(e) Positive predictive value 


_ (Sensitivity) (Prior Probability ) 
ae = (Sensitivity ) (Prior Probability ) + (1—Sensitivity(1—Prior Probability ) ) 
(f) Likelihood ratios 
Sensitivit 1 — Sensitivit 
i= LR-= ie 
(1 — Specificity) Specificity 


2. Cohort analysis for binomial data 


Disease 
Yes No 


Exposure Yes| a | 6 | 
Lc 





c/d 
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9.19 FLUID MECHANICS 





e Aarea e T temperature 
e g gravity e v velocity 
e h height e V volume 
e M molar mass e yp fluid viscosity 
e nm number of moles of gas © Lm mass of molecule 
e N number of molecules e v kinematic viscosity 
e P pressure e w vorticity 
e Q volume flow rate e p density 
e FR gas law constant + 8.31-4; 
e kp Boltzmann’s constant + 1.38 x 107-734 
Equations 
3 
1. Average molecular kinetic energy Kag = 5* Br 
2. Basic relations w=VXY, gece 
p 
1. 
3. Bernoulli’s equation P+pgh+ 5 pv” = constant 
4. Boyle’s law PV =constant 
e) 
5. Continuity equation e +V-(pv) =0 
6. Euler equation (incompressibility constraint and the following) 
OV 
= -Vv| =-VP 
p ( Ot +v v) 
7. Hydrostatic pressure P=Po+pgh 
8. Ideal gas law PV =nRT = NkpT 
9. Incompressibility constraint (constant density) V - (v) = 0 
10. Navier-Stokes equations 
0 
p (> +V- vv) =-—VP + pV?v + (body force) 
Sometimes the “body force” is —pgh due to hydrostatics. 
/3RT 3kel 
11. Root mean square velocity Vine = 4) —— = lta 
M Lm 
inertial f 271, L 
12. Reynolds number Re = eas casa) pn ae / me 
viscous forces uu / L? m 
where L is a characteristic length scale. 
13. Volume flow rate Q = Av 


9.20. HUMAN BODY 713 





9.20 HUMAN BODY 


Notation 
e aage (years) e BMR basal metabolic rate (a) 
e BMI body mass index e LBM lean body mass (kg) 
e BSA body surface area (m?) e MET metabolic equivalent of task 


e w weight (wxg for kilograms, wp» for pounds) 
e h height (hem for centimeters, hm for meters, hin for inches) 


Equations 
1. Basal metabolic rate 








e Using LBM BMR = 500 + 22 LBM 
e Mifflin—St. Jeor equations 
— Men BMR = 10 weg + 6.25 hem — 5a +5 
= 22 Wib 2.46 hin —5a+5 
— Women BMR = 10 wy + 6.25 hem — 5a — 161 
= 22wp +2.46hin — 5a — 161 
2. Body mass index BMI = = (metric units) 
= 703-5 (English units) 


An “optimal” BMI value may be between 18.5 to 25. 
3. Body surface area 


e Dubois & Dubois BSA = 0.20247 Ag.??? wy.47° 


e Gehan & George BSA SOA i 
\/ hem Wkg 
e Mosteller BSA = —_ 


4. Caloric needs = BMR x (lifestyle factor) (Harris Benedict formula) 


(lifestyle factor) = 1.2 for sedentary lifestyle 
(lifestyle factor) = 1.375 for lightly active lifestyle 
(lifestyle factor) = 1.55 for moderately active lifestyle 
(lifestyle factor) = 1.725 for very active lifestyle 

e (lifestyle factor) = 1.9 for extra active lifestyle 


5. Calories burned = (duration in minutes) x MET x 3° x wg 


Sample MET values: 

sleeping 0.9 © jogging 7.0 
watching television 1.0 e calisthenics 8.0 
walking at!.7 mph 2.3 © rope jumping 10 
walking at3.4mph 3.6 

bicycling at 10 mph 4.0 
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9.21 MODELING PHYSICAL SYSTEMS 


For many physical systems there are “across variables” A (whose value is the differ- 
ence between two measurements) and “through variables” 7’. For these systems: 


ie 


Ds 


There is a through-type energy storage device; the energy stored scales as the 
square of the 7’ variable. 
There is an across-type energy storage device; the energy stored scales as the 
square of the A variable. 


. When using a graph (whose edges represent components) to model these sys- 


tems there are conservation laws analogous to Kirkhoff’s laws in electricity: 


T; =0. 
A; = 0. 


(a) Conservation of through variables at each node: >) ,-jge 
(b) Conservation of across variables along closed loops: 5> 


j€loop 


|Domain = —_| across variable (A) | through variable (7) 


volume Row rte Q 
mechanical (rotation) angular velocity w 
mechanical (ransation 





Let FE’, be the energy stored in an A-type energy storage device, E’r be the energy 
stored in a T’-type energy storage device, and let P represent dissipated power. 


i: 


2 


3: 


4. 


Electrical C' = capacitance, L = inductance, R = resistance 

A variable E,= sCV? T= a 

T variable Er =5LP V=L4 

Power & constitutive P=IV= 3V? L= ZV 

Fluid J = fluid inertance, Cy = fluid capacitance, Rr = fluid resistance 
A variable E,= 4C7P? Q= Oe 

T variable Er = $1Q? P=I[#2 

Power & constitutive P=QP= Be Q= me 
Mechanical (rotational) 

B = rotational damping, K = rotational stiffness, J. = moment of inertia 
A variable Ea = 3Jw? T=J# 

T variable Ey =4%¢F°? w=-t 

Power & constitutive P=Tw = Bu? T = Bw 
Mechanical (translational) m = mass, k = stiffness, b = damping 
A variable E, = $mv* F= me 

T variable Erp =4¢F° v=ze 


Power & constitutive P= Fv = bv? F = bv 
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9.22 OPTICS 


e f = focal length e P =power of a lens 
e M = magnification of a lens e r =radius of curvature of a lens 
e n= refractive index e v = speed of light 
e s =distance (s, lens to object; s; lens to image) 
Equations 


1. A converging lens is “thicker in the center” than on the edges and has f < 0, 
a diverging lens is “thinner in the center” than on the edges and has f > 0. 
2. Focal length 


1 1 1 
(a) For thin lenses in contact: = = — + — 
f fi fe 
(b) For thin | ted by d ( meee Eh z 
or thin lenses separated by d (wi pic=—t+r-- 
‘. 4 f fi fe fife 


1 
(c) Thin lens formula: — = — + —. 
i Si So 
3. Lensmaker’s equation (d = thickness of a lens) 
1 1 (Mens — 1)d 


1 
For a lens in air: — = (nen; — 1) | — — — + ———-— 
(a) For a lens in air 7 (m4 (z Re + ata 


1 lens ~ /4 1 1 

(b) For a thin lens: — = as — pee 

f n Ri Re 
. . ; 5; image height 
4. Magnification of a thin lens: M = — = ————_ 
So object height 
5. Lens power l 
(a) Power of a thin lens: P = F 
1 1 1 


(b) Power of many thin lenses in contact: P = — +—+—+—4... 
4 


(c) Power is measured in diopter units; the inverse of the fosal Teneth in me- 
ters (i.e., 1 meter/f). For example, a lens with a focal length of 500mm 
has poh. = +2 diopters. For lenses in contact, diopters can be added: 
a —2 diopter lens and a +4 diopter lens give a +2 diopter lens. 

6. Snell’s law: n, sin 6, = n2 sin 2 where 6; is the angle of the light ray. 
7. Matrices in optics 


(a) Propagation in free space: F | where d is distance 


il 0 
(b) Refraction at curved surface: pe na | (R = oo for flat surface) 
Rn2 n2 


(R = ow for flat mirror) 


(c) Reflection from curved mirror: | 


1 
(d) Thin lens: | 1 i 
F 
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9.23 POPULATION GENETICS 


Notation 
e N-. effective population size e s selection coefficient (s = 1 — w) 
e N; number of females e u mutation rate A > a 
e N,,, number of males e v mutation ratea + A 
e p frequency of allele A e w fitness (w = 1 —s) 
e q frequency of allele a 
e f inbreeding coefficient (probability two alleles in a diploid zygote are identical 
by descent) 
Information 


1. Effective population size (diploid individuals with separate sexes) 











es AN¢Nm 
N f + N, m 
. Equilibrium: balanced polymorphism 
{0 = SAA g 2 Saa 
SAA + Saa , SAA + Saa 
. Equilibrium: recurrent mutation and selection ¢ = = 
Sa 
Equilibrium: mutation p fi 
. Equilibrium: mutati = ; = 
q oe a +v a7 +v 
. Fitness W = p’waa + 2pqwaa + (Waa 
. Genetic drift (in one generation) 
edi He 
variation = — 
e 
. Hardy-Weinberg equation p?+2pqt+q? =1 
. Inbreeding 
e frequency of AA p+ pat 
e frequency of Aa p — 2paf 
e frequency of aa q + paf 
. Mutation (generation (t — 1) to generation t) 
e generational change A = (upi-1 — UG@-1) 
e frequency of A @=U-1t+A 


e frequency ofa pe=pri-A 
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9.24 QUANTUM MECHANICS 


Notation 
e A, B Hermitian operators e m mass 
e cspeed of light (= 3 x 10° m/sec) e p, p momentum 
e FE energy e wavelength 
e f frequency e W wavefunction 
e H Hamiltonian e o standard deviation 
e h=h/2r e [,] commutator 
e J, angular momentum e (,) bracket 
Equations 
oO oO ; 
1. Correspondences Bw hae Da > tha, pr -ihV 
ie 
2. Dirac matrices 
10 0 0 0 001 000 -i 001 0 
pba ad Slee 5 Sah ae | aes 8) aie |_Oterd| 
00 0-1 -1 000 -i00 0 010 0 
3. Energy 
(a) blackbody radiation (n=1,2,...) E=nhf 
(b) photon (Plank’s law) E=hf 
(c) particle E=pc= mc? 
(d) released by nuclear fission or fusion E=Amc 
4. Heisenberg uncertainty principle 
1 1 
(A) (B?) >A BPP or oan > 5I((4,B))| 
Examples: 
A h 
Ox On, = O position Omomentum = 9 O position Okinetic energy = om, \(Der) | 
A h 
Oenergy time = 9 OJ; oJ; = 2 \( Jz) | 
5. Probability density = ||? = v* 
6. Schrédinger equation 
no nv =(2_4v)e=(-Ewiv)y 
Ot —~K2 7 
d dA i 
7. Ti luti — (A) =( — —(|H,A 
ime evolution cra, ) (Seed , Al) 
h 
8. Wavelength A\=- 
Pp 
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9.24.1 DIRAC BRAKET NOTATION 


Bra-ket notation is used for vectors and linear functionals; its use is widespread in 
quantum mechanics. The elements are: “bra” (@|, “ket” |W), and “bra-ket” (¢|1). 


1. 
De 
3; 
4. 


2: 


6. 


ve 


A ket is conceptually a column vector: |) = [co ci c2 .. he 
A bra is the conjugate transpose of the ket and vice versa. 
The bra corresponding to the above ket |w) is conceptually the row vector 
Wl=[e & & 
The combination of a bra with a ket to form a complex number is called a 
bra-ket or braket. 
If A is a linear operator, then 
(a) Applying the operator A to the ket |) results in the ket (A |w)) which 
may be written | Aw). 
(b) Composing the bra (@| with the operator A results in the bra ((¢| A). This 
is a linear functional defined by ((¢| A) |) = (d| (A |w)) = (| Ald) = 


(¢| AY) 
(c) The outer product |) (¢)| is arank-one linear operator that maps the ket 
|p) to the ket |@) (4|); note that (|p) is a scalar. 


The bra and ket operators are linear. If the {c;} are complex numbers, then 


(| (er [W1) + 2 |2)) = e1 (Aldi) + €2 (P|Y2) 
(cr (p1| + €2 (bal) |W) = 1 (G1) + €2 (hale) 


The bra and ket operators are associative: 


(9| (Al¥)) = ((9] A) IY) 
(A|h)) (@l = ACY) (91) 





In quantum mechanics: 


1. 


2: 
3 
. Quantum mechanical operators are easily represented: 


The expectation of an observable represented by the linear operator A in the 


state |v) is (Ald). 
(|1)) is the probability that state ~ collapses into the state ¢. 


The Schrédinger equation is H |v) = E|W) 


(9.24.1) 


. A quantum wave function is represented as U(x) = (x|W). A linear operator 


acting on this wavefunction is understood to operate on the underlying by kets 
by Aw(x) = (x|Alq). Likewise: U, = (p|V), and Uy, = (kl), 
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9.25 QUATERNIONS 


@ p point in space e wunit vector 
e q quaternion e @ rotation angle 
Equations 


1. Quaternions are four-vectors that have the representations 
q=wtaityjtzk=[w x y =(s,v) 
where s=w,v=[x y_ 2], and {i,j,k} represent unit vectors that satisfy: 


i=jekko =i. (=-jfSk, je=-jsi, B=-k=j 








2. The multiplication of two quaternions q, = (s1,Vvi1) and qg = (52, V2) is 
another quaternion 4195 = (5152 — V1 + V2, 81V2 + 52V1 + V1 X Va). 

3. The inner product of two quaternions q; = (s1,v1) and qy = (s2,V2) isa 
scalar Gi °G2 = G2°q, = $182 + V1: Vo. 

4. The conjugate of q is q =w-—vzi-— yj — zk = (s, —v) 

5. The magnitude of q is ||q|| = qq! = \/w?2 + 22 + y? + 22 = V/s? + |Iv]|? 

6. A unit quaternion has ||q|| = 1. For a unit quaternion q~' = q’. 

7. Quaternion multiplication is associative: (q192)43 = 4) (243) 

8. Quaternion multiplication is not commutative: q,q. # q2q, in general. 

9. Rotations 


(a) For the unit vector u, the unit quaternion q = (s,v) with s = cos g and 
v=usin g represents a rotation about u by the angle @. (The rotation is 
clockwise if our line of sight points in the direction pointed to by u.) 

(b) A point in space p can be represented by the quaternion P = (0, p). This 
point, when rotated, has the representation Protated = qPq"! = qPq’. 

(c) To rotate p by the unit quaternions {q,}"_, (first by q,, then by qo, ...) 
form Pyotated by {q;} — (qn ene 42491) P(q,, tee G21)’. 

(d) The orthogonal matrix corresponding to a rotation by the unit quaternion 


qg=a+bi+cj+ dk is 


a? + b? — c? — d? 2bc — 2ad 2bd + 2ac 
2bc + 2ad a? —b? +2 — d? 2cd — 2ab 
2bd — 2ac 2cd + 2ab aw—-P-e@4+a0 


20 


EXAMPLE Consider rotation about the axis w = i+ j + k by an angle of 120° = = 
radians. The appropriate unit quaternion is 


QO w . 86 mn itj+k.a7 1 i+j+k 
q = (s,v) = | cos =, —— sin = ] = { cos =, —~ —— sin = } = | =, ——_ 
2” || w]| 2 3 V3 3 2 2 


If a point has the representation p = ai + bj + ck then 
(1,i+j+k) (1, -i- j—k) 
2 2 
as expected. (The rotation corresponds to a cube, held fixed at one point, being rotated 

about the long diagonal through the fixed point. This permutes the axes cyclically.) 





Protea = q (0,p) q’ = (0, ai + bj + ck) =ci+aj+bk 
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9.26 RADAR 


c speed of light (+ 3 x 10° m/sec) e RF; Range - transmitter to target (m) 
F Receiver noise factor e T effective noise temperature (°K) 
G,, Receiver gain e kp Boltzmann’s constant 

G, Transmitter gain kp & 1.38 x 10-232 


I General loss factor X Radar wavelength (m) 

P,, Received power (Watts) o Target radar cross section (m?) 
P, Transmit power (Watts) e 7 pulse duration (s) 

e R,. Range - receiver to target (m) 


If the radar is monostatic then G’, = G; and R, = R;. 


1. Radar equation iy 
P,GiG,A*o 


” ~ (4r)?RER2L 
2. Noise (assuming the white noise power spectral density (PSD) is kT) 


kTF 
N =— 
a 
3. Signal to Noise valig (SNR) usually expressed in dB é 
SNR = — SNR in dB = 10 logy, (=) 


4. Pulse repetition frequency (PRF)= 1/7 
5. The practical (unambiguous) range= c(PRI)/2 
6. Radar cross section for different geometries (when ) is sufficiently small) 


(a) corner reflectors (a is a characteristic length) 











8rat 127a* 
dihedral: o = - trihedral: o = oF 
An A? 
(b) planar surface of area A: c= > 
2rab? 
(c) right circular cylinder (radius a, height b): c= ~ 
(d) sphere of radius a: o= 7a" 


urface-to-air- 
missile 


Standard Radar Frequencies 


and 
TL [_F2GRiz [30.0150 em, 
fS__[24Grz | S-75em, 
[Co [8G [753.8 om, 


“orner reflector 
with 1.5 m edge 


[K [1827 GHe | _17-1-tem, 
PV [40-75 Giz [075-040 em 
Pw [5-110 GE 


TX | 8-12GHz| 3.8-2.5cm 


12-18 GHz [_2.5-I.7cm 
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9.27 RELATIVISTIC MECHANICS 


e cspeed of light (~ 3 x 10° m/sec) e v velocity 
e m mass e z redshift 
e ¢ time e £ Lorentz transformation factor 
e «x distance 
Equations 
v2 
1. Factor B= 1-+ 
y Cc 
2. Redshift Z=- 
Cc 
3. Relativistic length contraction Az = 8 Axo 
er 5 mo 
4. Relativistic mass increase m= o 
At 
5. Relativistic time dilation At=— 


9.27.1 LORENTZ TRANSFORMATION 


e cspeed of light (= 3 x 10° m/sec) ox =|2° 2 = oF] 
em=aa e ¢ time 


e {x',x?, x} spatial dimensions 


The Lorentz group of transformations, A, leaves the length of the 4-vector x, invari- 
-1000 

ant under the flat space-time metric: g = | i 4 . Proper Lorentz transforma- 
0001 


tions have |A| = 1 and are continuous with the identity transformation. 
The transformation A can be written as A = exp (- ey (0:5; + GK) 


where 6 and ¢ are constant 3-vectors; their components are the six parameters of the 
transformation. The {S;} matrices generate rotations in three spatial dimensions: 


000 0 0 000 00 00 
000 0 0 001 00-10 
a= [988 8], s.= |! aoa, Catt ie (9.27.1) 
001 0 0-100 00 00 
The { K;,} matrices produce boosts: 
1000 0000 00.00 
Ki =|ooo00]> Ko= | 1000]: K3=]0000 (9.27.2) 
0000 0000 1000 
Powers of these matrices may be produced from the relations: 


00 0 0 0 00 0 0 0 00 
2_ 100 0 0 2_ |0-10 0 2_ |0-1 00 
S = [ses |. S =[3 00 Af S, -(3 eck 
00 0-1 0 00-1 0 0 00 (9.27.3) 
1000 1000 1000 ~ 
K2 —|0100 K2 —|0000 72 0000 
1=]0000]> 2=]o010]> 3=]0000]> 
0000 0000 0001 
along with $3 = —S;, K3 = K; and the commutator relations [5;,.9;] = €:;~ Sz, 


(Si, Kj] = ein Ku, and [Ay, Kj] = —ei;~,K,, where €;;, is the permutation symbol. 
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9.28 SOLID MECHANICS 


Notation 
e Aarea e v velocity 
e C stiffness (tensor) e V volume 
e F Young’s modulus e © strain (tensor) 
e F',F force e X first Lamé parameter 
e G shear modulus (G' = pu) e y shear modulus (44 = G) 
e J identity matrix e v Poisson’s ratio 
e K bulk modulus e p density 
e P pressure e o stress (tensor) 
e u displacement e tr( ) trace function 


Equations 


1. Basic relations 








F iL OP 
oA 3 (0) av 
1 1 1 
e=5(Vu+ (Vu)") or ey = 5 (uig + Ug,i) = 5 (Oius + Ojus) 
Oi =O} Gp = Ej Cizet = Crrig = Coiri = Cigtr 


2. Constants: Engineering {G, Y, v} Lamé {), } 


3. Relations between constants (homogeneous isotropic materials) 
_ W(B3A + 2u) 








E= a = 2G(1 + v) =3K(1—2v) 
nN EB 
= FA+uy IC 
fs A(1 — 2v) ee 
2v 2(1+v) 
Ev . 24 
~ 21+v)(1—2v) 3° 
4. Equations of motion pu=V-o0+F or Pons = Oj + Fi 
5. Hooke’s Law Oij = Cigri€ni 
6. Navier equations (steady state) (A + 2u)V(V -u) — pV x (V x u) = 0 
7. Saint-Venant’s conditions €ij,km + €km,ij — €ik,jm — €jm,ik = O 
8. Speed of sound v= ~ 


9. Stress—strain relation (homogeneous isotropic material) 
ao = Que + Atr(e)I or Cig = 2WEiy + AOi7 Eke 


il 
E45 = E ((1 + V)O%; bee Vij kk] 
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9.29 STATISTICAL MECHANICS 


Notation 
e F; energy e v velocity 
e m mass e y chemical potential 
e T temperature e p probability density 
e Z(T) partition function 


e g; degeneracy (number of states with energy F;) 
e kz Boltzmann’s constant ~ 1.38 x 10-784 
e N; number of particles with energy F; 
Equations 
ee oe Ni ge Ueiieee) 
1. Boltzmann distribution v= - way 
with N = >>, N; and Z(T) = >, gie Bi/(*27) 


2. Energy distributions [ f(£) is the probability that a particle has energy E] 


1 
Bose—Einstei 5) =a 
(a) Bose-Einstein f(£) CE/RT — 1 
b) Fermi—Di ff) = Sar 
(b) Fermi—Dirac f(E) eE/kT 41 
M 1l-Bolt ff) == 
(c) Maxwe oltzmann f ( ) eE/kT 
3. Characteristic speeds 
2 
(a) Average speed Vaverage = —=Umax 
Vr 
2T 
(b) Maximum speed Umax = \/ — 
m 


(c) Root mean square speed = Uyms = 3 Umax 





3/2 
m ) / eo mlvl?/2T 


4. Maxwellian distribution p(v) = no ( aT 
47 


5. Particle thermal energy 


(a) One dimensional = 





(b) Three dimensional = 
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9.30 THERMODYNAMICS 


e State variables e Thermodynamic potentials 
— N particl b 
P anes — A Helmholtz free energy 
— P pressure : 
— Q heat — G Gibbs free energy 
S — H Enthalpy 
— © entropy ia 
— T temperature = nternal energy 
— V volume 


— y chemical potential 
— v; frequency 
e o Stefan’s constant (© 5.67 x 10-84.) 
1. Laws of thermodynamics 
(a) Energy cannot be created, or destroyed, only modified in form. 
dU = 6Q — 6W where 
i. dU increase in internal energy of the system 
ii. OW infinitesimal amount of Work (W) 
iii. OQ infinitesimal amount of Heat (Q) 
iv. 6 is an “inexact differential” (i.e., path-dependent) 


(b) A system operating in a cycle cannot produce a positive heat flow from a 
6 
colder body to a hotter body. / = — / dS > 0 


(c) All processes cease as temperature approaches zero. 
If 7’ goes to zero then S' becomes constant. 


The zeroth law states that if two systems are in equilibrium with a third system, 
then the two systems are in equilibrium with each other. 
2. Thermodynamic potentials 


dA(T,V,N;) =—-SdT — Pdv+5_ dN; 


dG (T, P,N;) =—-SdT+VdP+ S- ud; 





dH ($,P,Nj))= TdS+VdP+ 5) wdN; 





dU (S,V,N;))= TdS—PdV+ 5° wdN; 


. Entropy change at constant T (for phase changes) AS = Q/T 
4. Planck’s law (electromagnetic radiation at all wavelengths emitted from a 
2hv 1 


ies) 


black body in a cavity in thermodynamic equilibrium) 


Nn 


. Stefan’s law rate of energy radiated = oT* 
6. Work done on/byagas W = PAV 
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10.1 CALENDAR COMPUTATIONS 


10.1.1 DAY OF WEEK FOR ANY GIVEN DAY 


The following formula gives the day of the week for the Gregorian calendar (i.e., for 
any date after 1582): 
C 


We (a+ 26m - 0.2] +¥4 =| in Ic 


7 -2c) (mod 7) (10.1.1) 


where 
e W is the day of the week (Sunday => 0,..., Saturday => 6). 


e dis the day of the month (1 to 31). 

e mis the month where January and February are treated as months of the pre- 

ceding year: March = 1, April > 2, ..., December = 10, January = 11, 

February => 12. 

C is the century minus one (1997 has C' = 19 while 2025 has C' = 20). 

Y is the year (1997 has Y = 97 except Y = 96 for January and February). 

|-| denotes the integer floor function. 

The “mod” function returns a non-negative value. 

EXAMPLE Consider the date 16 March 2017 for which d = 16, m = 1, C = 20, and 
Y = 17. From Equation (10.1.1), we compute 








20 
4 


=2+4+24+34+4+5-5 (mod 7)=4 (mod 7) 


Weer. aire |Z] 4/7? |= (mod 7) 


So this date was a Thursday. 


Notes: 
1. In any given year the following dates fall on the same day of the week: 4/4, 


6/6, 8/8, 10/10, 12/12, 9/5, 5/9, 7/11, 11/7, and the last day of February. 

2. Because 7 does not divide 400, January | occurs more frequently on some days 
of the week than on others! In a cycle of 400 years, January 1 and March 1 
occur on the — days with the following frequencies: 





—— 1} 58 | 56 | 58 | 57 | 57 | 58 | 56 
. The 13th of a month is more likely to be a Friday than any other day. 
4. Excel uses a sequential integer for each day, with day | being 1 January 1900. 


ie) 


10.1.2 LEAP YEARS 


If a year is divisible by 4, then it will be a leap year, unless the year is divisible by 
100 (when it will not be a leap year), unless the year is divisible by 400 (when it will 
be a leap year). Hence the list of leap years includes 1896, 1904, 1908, 1992, 1996, 
2000, 2004, 2008 and the list of non-leap years includes 1900, 1998, 1999, 2001. 
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10.2 CELLULAR AUTOMATA 


In a cellular automata there is a grid of cells with each cell containing a state. The 
cellular automata evolves according to rules. For a specific cell, the current state of 
that cell and the cell’s neighbors control the state of that cell in the next iteration. 

In the simplest case the cells are in a rectangular grid and the states are either 
0 or | (indicated graphically as white and black). We assume that initially all cells, 
except some specific ones, are white. 

In a one-dimensional cellular automata there is a row of cells whose contents 
are replaced each iteration using the rules. Graphically, the sequence of states is 
shown as a two-dimensional figure, with each new set of states appearing below the 
previous states. If a cell is updated based on its current value and the value of its 2k 
nearest neighbors (& on each side), then the next state is based on the current state of 
2k + 1 of cells. There are oe") possible sets of rules in this case. 

In the case of k = 1 there are 2(2") = 256 sets of rules. A specific rule in this 
case is a set of triplet mappings, denoted textually {(111 > 0), (110 => 0), ..., 
(001 = 1), (000 = 0)} or graphically: 


111 110 101 100 O11 010 OO1 000 

mm Fe BOL OF CH UO UO 

I I I a Sy I I I 

1,0 O,0 ,O 6,1 8,1 8,1 Bl ,0 

The sequence of 0’s and 1’s that the rule produces can be interpreted as the number 

of the rule. Hence, the above rule is rule number 30 (since 30 = 000111102). 
Starting from a single black square, the following shows the evolution of rule 30 

after 10, 50, and 100 iterations. 


















































Even in the simple case of a one-dimensional cellular automata, with two types 
of states, and only nearest neighbor interactions, there is a wide variety of possible 
behavior. Below are the results of several different rules after 50 iterations: 
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e The cellular automata with rule 30 is chaotic. 
e Conway’s Game of Life is a two-dimensional cellular automata. 
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10.3 COMMUNICATION THEORY 


10.3.1 INFORMATION THEORY 


Let py = (Pzx,,Px5;---;Pzx,,) be the probability distribution of the discrete random 
variable X with Prob (X = x;) = pz,. The entropy of the distribution is 


H(px) = — > pe, logs pei. (10.3.1) 


The units for entropy are bits. Entropy measures how much information is gained 
from learning the value of X. When X takes only two values, p = (p, 1 — p), then 


H(px) = H(p,1— p) = —plog, p — (1 — p) log, (1 — p). (10.3.2) 


This is also denoted H(p). The range of H(p) is from 0 to 1 with a maximum at 
p = 0.5. Below is a plot of p versus H(p). The maximum of H(px,) is log, n and is 
obtained when X is uniformly distributed, taking n values. 


1 
0.8 
0.6 
0.4 





0 0.2 0.4 0.6 0.8 1 


Given two discrete random variables X and Y, px, is the joint distribution of 
X and Y. The mutual information of X and Y is defined by 


I(X,Y) = H(py) + A (py) — A(pxyy). (10.3.3) 


Note that (a) [(X,Y) = I(Y, X); (b) I(X, Y) > 0; and (c) 1(X, Y) = Oif and only 
if X and Y are independent. Mutual information gives the amount of information 
that learning a value of X says about the value of Y (and vice versa). 


10.3.1.1 Channel capacity 


The transition probabilities are defined by tz, = Prob (Y = y | X = x). The distri- 
bution px determines py by py = >> tx,ypx. The matrix T = (tz,,) is the transition 
matrix. The matrix T' defines a channel given by a transition diagram (input is X, 
output is Y). For example (here X and Y only take two values), 

Xo S00 Yo 
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The capacity of the channel is defined as 
C = maxI(X,Y). (10.3.4) 
Px 


A channel is symmetric if each row is a permutation of the first row and each 
column is a permutation of the first column. The capacity of a symmetric channel 
is C = log, n — H(p), where p is the first row; the capacity is achieved when px 
represents equally likely inputs. The channel shown on the left is symmetric; both 
channels achieve capacity with equally likely inputs. 


Binary symmetric channel Binary erasure channel 


0 1—p 0 0 Le 0 


Ip Lp 
C=1-H(p) C=1-p 


10.3.1.2 Shannon’s theorem 
Let both X and Y be discrete random variables with values in an alphabet A. A code 
is a set of codewords (n-tuples with entries from A) that is in one-to-one correspon- 
dence with a set of IZ messages. The rate R of the code is defined as + log, M. 
Assume that the codeword is sent via a channel with transition matrix T’ by sending 
each vector element independently. Define 

e€= max _ Prob((codeword incorrectly decoded)) . (10.3.5) 


all codewords 


Shannon’s coding theorem states: 


1. If R < C, then there is a sequence of codes with rate R and n > oo such that 
e— 0. 
2. If R > C, then e is always bounded away from 0. 


10.3.2 BLOCK CODING 
10.3.2.1 Definitions 


A code C over an alphabet A is a set of vectors of a fixed length n with entries from 
A. Let A be the finite field GF(q) (see Section 2.5.8.1). If C is a vector space over 
A, then C is a linear code; the dimension k of a linear code is its dimension as a 
vector space. The Hamming distance dy(u, v) between two vectors, u and v, is the 
number of places in which they differ. For a vector u over GF(q), define the weight, 
wt(u), as the number of non-zero components. Then dy(u,v) = wt(u — v). The 
minimum Hamming distance between two distinct vectors in a code C is called the 
minimum distance d. A code can detect e errors if e < d. A code can correct t errors 
if 2t+1<d. 


10.3. COMMUNICATION THEORY 731 


10.3.2.2 Coding diagram for linear codes 


Encoding Channel Decoding 


inion 


. A message x consists of k information symbols. 

. The message is encoded as xG € C, where G is a k x n matrix called the 
generating matrix. 

. After transmission over a channel, a (possibly corrupted) vector y is received. 

4. There exists a parity check matrix H such that ¢ € C if and only if cH = 0. 

Thus the syndrome z = yH can be used to try to decode y. 


5. If G has the form [I A], where I is the & x k identity matrix, then H = Fi 


Noe 


1S) 


I 
10.3.2.3 Cyclic codes 


A linear code C’ of length n is cyclic if (ao,a1,...,@n—1) © C implies 
(Gn—1,40,---, dn—2) € C. To each codeword (ao, a1,...,@n—1) € C is associated 
the polynomial a(x) = S7"p aia’. Every cyclic code has a generating polyno- 
mial g(a) such that a(x) corresponds to a codeword if and only if a(x) = d(x)g(a) 
(mod 2” — 1) for some d(x). The roots of a cyclic code are roots of g(x) in some 


extension field GF(q’) with primitive element a. 


1. BCH Bound: If acyclic code C has roots a’, a’*!,..., a’t4-?, then the min- 
imum distance of C’ is at least d. 

2. Binary BCH codes (BCH stands for Bose, Ray-Chaudhuri, and Hoc- 
quenghem): Fix m, define n = 2’” — 1, and let a be a primitive element 
in GF(2™). Define f;() as the minimum binary polynomial of a’. Then 


g(a) = LCM (fi(a),..-, fee(x)) (10.3.6) 


defines a generating polynomial for a binary BCH code of length n and mini- 
mum distance at least 6 = 2e + 1 (6 is called the designed distance). The code 
dimension is at least n — me. 

3. Dual code: Given a code C, the dual code is Ct = {a | a-x = 0 for all 
x € C}. The code C+ is an (n,n — k) linear code over the same field. A code 
is self-dualif C = C+. 

4. MDS codes: A linear code that meets the Singleton bound, n + 1 = k + d, is 
called MDS (for maximum distance separable). Any k columns of a generating 
matrix of an MDS code are linearly independent. 

5. Reed-Solomon codes: Let a be a primitive element for GF(q) and n = gq — 1. 
The generating polynomial g(x) = (x — a)(a — a?) --- (aw — a7") defines a 
cyclic MDS code with distance d and dimension k = n —d +1. 

6. Perfect codes: A linear code is perfect if it satisfies the Hamming bound, 
q’* = YY (")(q — 1)". The binary Hamming codes and Golay codes 
are perfect. 


732 
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7. Binary Hamming codes: These codes have parameters {n = 2" —1,k = 
2™ —1—m,d = 3}. The parity check matrix is the 2” — 1 x m matrix whose 
rows are all of the binary m-tuples in a fixed order. The generating and parity 
check matrices for the (7,4) Hamming code are 


G=[1 A]= 


So. Oro. = 
CooroO 
oreo 


8. Ternary Golay code: 
generating matrix is 


Galr, Ala 


eH OOO 
rFPOrRFR 
PROF 


100000 
010000 
001000 
000100 
000010 
000001 


10.3.2.4 Table of best binary codes 


Let A(n,d) be the number of codewords! in the largest binary code of length n 
and minimum distance d. Note that A(n — 1,d — 1) = A(n,d) if dis odd and 
A(n, 2) = 2”~! (given, e.g., by even weight words). 


72-719 
144-158 
256 
512 
1024 


2048 
2720-3276 
5248-6552 

10496-13104 
20480-26208 


36864-43690 
73728-87380 
147456-173784 
2949 12-344636 





128 


256 
256-340 
512-680 

1024-1288 
2048-2372 


2560-4096 
4096-6942 
8192-13774 
16384-24106 


011111 
101221 
110122 
121012 
122101 
112210 


of RNY NNNRF KE 


an 


32 
36-37 
64-74 

128-144 
256-279 


512 
1024 
2048 
4096 


DF FNNNNY NRK KS 


N 
oo 


40 


42-48 

68-88 
64-150 
128-280 





ORF ORF 


oO 


COrRPOrFRrFOF 


0 


FPOOrRFREH 


This has the parameters {n = 12,k = 6,d = 6}. The 


(10.3.7) 


'Data from Sphere Packing, Lattices and Groups by J. H. Conway and N. J. A. Sloane, 2nd ed., 


Springer-Verlag, New York, 1993. 
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10.3.2.5 Bounds 


Bounds for block codes investigate the trade-offs between the length n, the number 
of codewords M/, the minimum distance d, and the alphabet size g. The number of 
errors that can be corrected is e with 2e+1 < d. If the code is linear, then the bounds 
concern the dimension k with M = q*. 


1. Hamming or sphere-packing bound: M < q” / Y>\_-9 (7)(a- iy ; 
2. Plotkin bound: Suppose that d > n(q — 1)/q. Then M < 
n—d+l1. 


qd— ce 1)° 

3. Singleton bound: For any code, M < q ; if the code is linear, then 
k+d<n+l. 

4. Varsharmoyv-Gilbert bound: There is a block code with minimum distance at 


least d and M > q” j ee, (e= 1)" 


10.3.3. SOURCE CODING FOR ENGLISH TEXT 


English text has, on average, 4.08 bits/character. 


Probability Aphabetical code 


ae 0 
011111 010100 
11111 010101 
01011 01011 


101 0110 
001100 011100 
011101 011101 
1110 01111 
1000 1000 


0111001110 1001000 
01110010 1001001 
01010 100101 
001101 10011 
1001 1010 


0110 1011 
011110 110000 
0111001101 110001 
1101 11001 
0010 1101 


0010 1110 
11110 111100 
0111000 111101 
001110 111110 
0111001100 1111110 


001111 11111110 
0111001111 11111111 


4.0799 4.1195 4.1978 


“~“Tattm oawp 


J 
K 
L 
M 
N 
O 
P 
Q 
R 
S 
T 
U 
Vv 
WwW 
x 
Y 
Z 
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10.4 CONTROL THEORY 


General terminology 


1. 


If the control is bounded above and below (say u;_ < u; < uj), then a bang— 
bang control is one for which u; = u; or uj = ul. (That is, for every t, either 
u(t) = uj (t) or u;(t) = uf (t); switches are possible.) A bang—off-bang 
control is one for which u; = 0, u; = u; , or u; = ut. 


. If u(t) is the control signal sent to a system, y(t) is the measured output, r(t) is 


the measured output, and the error is r(t) = r(t) — y(t), then the Proportional- 
Integral-Differential (PID) controller has the form 


u(t) = Kp e(t) + Kr f ett dt+Kp a) (10.4.1) 


. In H,, (i.e., “H-infinity”) methods a controller is selected to minimize the 


Hf, norm. The H,, norm is the maximum singular value of a matrix-valued 
function; over the space of matrix-valued functions which are analytic and 
bounded in the open right-half complex plane. 


10.4.1 CONTINUOUS LINEAR TIME-INVARIANT SYSTEMS 


Let x be a state vector, let y be an observation vector, and let u be the control. If a 
system evolves as: 


Ie 


2. 


x = Ax+ Bu 


— (10.4.2) 





Taking Laplace transforms and solving the algebraic equations results in y = 
G(s)t where G(s) is the transfer function G(s) = C(sI — A)"'B+ D. 

A system is said to be controllable if and only if for any times {to, t; } and any 
states {xo, x1} there exists a control u(t) such that x(to) = x9 and x(t,) = x). 
The system is controllable if and only if 


rank[B AB A?B ... A™-1B]=n. (10.4.3) 


For the discrete linear time-invariant system x(k + 1) = Ax(k) + Bu(k) the 
system is controllable if and only if Equation (10.4.3) is satisfied. 


. If, given u(t) and y(t) on some interval tp < t < ty, the value of x(t) can be 


deduced on that interval, then the system is said to be observable. Observabil- 
ity is equivalent to the condition 


rank lot AO ais (Ae-D)" CT] =n. (10.4.4) 
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10.4.2 PONTRYAGIN’S MAXIMUM PRINCIPLE 


Consider a system evolving as 


d 
- =b(t,x,u) x(0)=given t>0 (10.4.5) 


where u is the control. The goal is to minimize the total cost, defined to be 
V(x(0)) = | ee weToe ae) (10.4.6) 
0 
Define the Hamiltonian 
H(t,x,u, 4) = \"b(t,x, u) — c(t, x, u) (10.4.7) 


Pontryagin’s maximum principle states that, if (x,.,u..) is optimal then, for all t < 7, 
there are adjoint paths (A) and ju such that 


1. H(t,x,,u, A) + has a maximum value of 0, achieved at u = u, 





dn" ¢ 
2. = —X Vb(t, xx, Ux) + Ve(t, Xx, U.) 
di pdb(t,x.,u.)  dc(t,x.,Ux) 
3, — = —h + 
dt dt i dt 
dx, 
4. = = b(t, x., u.) 
5. Transversality conditions. Either (“time-constrained” means 7 is fixed): 
: ; dC 
(a) time un-constrained: jz + ae 0 


(b) time-constrained: Qt? + VC(r,x(7))) ¢ =O forallo €X 


Note that if b, c, and C do not depend explicitly on ¢, then u = 0. 
The first four statements can be written in terms of the Hamiltonian as 
OH dX OH d OH dx OH 
(22 Seok Sec 2S oan 
Ou dt Ox dt Ot dt Or 
Example Consider a car on a straight road with initial position po and velocity go. The 
goal is to bring the car to rest, at position 0, in minimal time. The control is the acceleration wu 
with |u| < 1 (ie., uw = 1 is full throttle and u = —1 is full reverse). The dynamics are: 


f]-$-rn-[]  wo-[). «=f 


The goal is to minimize i, 1 dt; where T is the first time for which x(T) = (0,0); hence 
c = 1andC = 0. Since time un-constrained, jz need not be considered. 
The Hamiltonian is H(t,x,u, 4) = Ab — ce = \q + Agu — 1. 
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1. To maximize H, u must be an extremal value. Since |u| < 1, we have wu» = sgn(A2). 
Hence, H = Axqg + |A2| — 1. 

2. When the car is stopped at t = T’, we have q(7') = 0; hence (since H = 0 for the 
optimal control) we have A2(T’) = +1. 





3. The adjoint equations are: os = a = 0 and <2 = _ = —A1. So 
Ai(t) = A1 is aconstant and A2(t) = A2(0) — Ait. 
al di A 
4. Note that ee nd = Z u = sgn(A2) 


di Om 1° dt Oro 
5. There are now cases to consider: 


(a) If Ao(T) = 1 and A; > 0, then A2(t) > 0. In this case g(t) = t and p(t) = 
2 2 





| 
2 2" 
(b) If A2(T) = 1 and Ay < 0, then A2(t) > 0 (and p = ©) only fort < to = Dar 

For t > to we have A2(t) < 0, so u = —1, q(t) = t — 2to and p(t) = 

a a 
There is a similar analysis for \2(7') = —1. The result is that there is a switching locus given 
by p= — sen(q)&. An initial state (po, go) that is above the locus lies on a parabola with 
p=- e + d with d > 0. The optimal control is to initially move around the parabola until 


the switching locus is reached. Then the acceleration changes sign and the car is brought to 
rest at the origin by moving along the locus. 





10.56 COMPUTER LANGUAGES 


Common computer languages used by scientists and engineers. 


1. Freely available 


e Numerical C++ www. gnu. org/software/commoncpp 
e Numerical Octave www. gnu. org/software/octave 

e Numerical SciPy www.scipy.org/ 

e Statistical R www.r-project.org 

e Symbolic Maxima maxima.sourceforge.net 

e Symbolic Sage www.sagemath.org 


2. Commercial 


e Numerical MathCad 
www.ptc.com/engineering-math-software/mathcad 


e Numerical MATLAB www.mathworks.com 
e Optimization AMPL www.ampl.com 

e Statistical Minitab www.minitab.com 
e 


Statistical SPSS 
www.ibm.com/analytics/us/en/technology/spss/ 
Symbolic Maple www.maplesoft.com 

e Symbolic Mathematica www.wolfram.com 
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10.6 COMPRESSIVE SENSING 


Compressive sensing is a way to combine compression with sensing. In this context, 
compression means dimension reduction. Define the following: 


1. A vector x € C” is k-sparse if only k elements are non-zero and k < n. 


2. x is “compressible” if only a small number of its elements are significantly 
non-zero. 


In many signal processing applications an n-dimensional signal x € C’” is to be 
found from the linear system 
Ax=b (10.6.1) 


where the measurement matrix A = [ai a... an| € C™*” and the m- 
dimensional measurement vector b € C’” are known. Ignoring degenerate cases: 


1. If m = n then this is a square system; there is a unique solution to Equation 
(10.6.1). We have the solution = A7'b. 


2. If m > n then this is an overdetermined system; there is no solution to Equa- 


tion (10.6.1). We sometimes use X = (AA) Ab which minimizes the 
residual || Ax — b||.. (.e., minimal least squares). 


3. If m <_ n then this is an underdetermined system; there are infinitely many 
solutions to Equation (10.6.1). We sometimes use X = Atb, where A* is the 
pseudo-inverse, which minimizes ||x||.. 


Compressive sensing is used to solve Equation (10.6.1) when the data is vastly 
undersampled (m < n) and the solution x is compressible (k < m). One way to 
find the sparsest solution x, the one with the least number of non-zero terms, is to 
solve 

min (||x||) | Ax = b, x € C”) (10.6.2) 


where ||x||,) is the number of nonzero terms of x. Unfortunately, the solution to 
(10.6.2) is generally not unique and solving (10.6.2) is NP-hard (i.e., computationally 
difficult). So, instead, consider the new problem 


min (||x||, | Ax = b, x € C”) (10.6.3) 
This problem can be solved using linear programming 


min 1'x 
with Az=b (10.6.4) 


—-x<z<x 


There are theorems indicating that, often, the solution to (10.6.3) works: 
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1. Suppose the problem has been scaled so that ||a;||, = 1. Define M(A) = 
max;4; jaja; |. If x* is the sparsest solution of (10.6.2) and 


va-} 
* —_—_ 10.6. 
then the solution of (10.6.3) is equal to the solution of (10.6.2). 
2. Let 6; be the smallest number such that 


(1 — 5x) IxII2 < ||Axll3 < (1+ 4x) IIll3 


for all k-sparse vectors x. If 52; < /2—1 for all k-sparse vectors x satisfying 
Ax = b then the solution of (10.6.3) is equal to the solution of (10.6.2). 


Notes 


e Compressive sensing often works since many natural signals are sparse in the 
sense that they have concise representations when expressed in the proper basis. 


e Often the observations b are noisy. In this case the optimization problem in 
(10.6.3) may be modified to be 


min ( IIx||, + |[Ax — b||3) (10.6.6) 


which contains an £, term promoting sparsity and an Ly term promoting a 
better fit to the data. The \ represents the tradeoff between the two. 





10.7 CONSTRAINED LEAST SQUARES 


The solution to the following constrained least squares problem 
min ||Ax—b||? subject to Cx = d (10.7.1) 


is given by (assuming non-degeneracy) 


x = (ATA)? (4% ~ 7 (c (ATA) ' CT) (c (ATA)! AT — a) 
(10.7.2) 
Special cases include: 
1. Using d = 0 and A = J in (10.7.1): 
the solution of min ||x — bl]? subject to Cx = 0 
is x=b-—C™(CC) ‘Cb 
2. Using b = 0 in (10.7.1): 
the solution of min || Ax||? subject to Cx = d 
is x= (ATA) 'CT(C (ATA) co) a 
3. Using b = Oand A = J in (10.7.1): 
the solution of min ||x||” subject to Cx = d 
is %«=C™(CCT)“‘d 
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10.8 CRYPTOGRAPHY 


Cryptography is the practice and study of hiding information. A cipher is a pair of 
algorithms for encrypting and decrypting the message. 


Suppose Alice wants to send a message (the plaintext) M to Bob. Using a key 


Alice encrypts M to create the ciphertext EL, and sends E to Bob. Bob converts 
back to M, also using a key. The goal is to make it difficult to convert FE to MW if 
some information is unknown. Common cipher classes include: 


Secret key cryptography uses one key for encryption and decryption. Examples 
include: 


— Data Encryption Standard (DES) is a block-cipher that is out of use. 
Triple-DES with 168-bit keys is currently used. 

— Advanced Encryption Standard (AES) uses a block-cipher with 128-bit 
keys and blocks. 


Public key cryptography uses one key for encryption and another key for de- 
cryption. These depend upon one-way functions; mathematical functions that 
are easy to compute but difficult to invert. (The existence of one-way functions 
has never been proven. If P = NP, then they do not exist.) 

For example, multiplying two 1,000-digit numbers is easy, factoring a 2,000- 
digit number to obtain its 1,000-digit factors is hard. Also, given two number 
a and b it is easy to compute a’. Given a number N that is of this form, it is 
difficult to determine a and b. 

Examples include: 


— Elliptic curve cryptography (ECC); see Section 10.10. ECC encryption 
exploits the difficulty of the logarithm problem. ECC methods provide 
security equivalent to RSA while using fewer bits. 

— RSA encryption (named after Rivest, Shamir, and Adleman) uses a vari- 
able size encryption block and a variable size key. RSA encryption ex- 
ploits the difficulty of factoring large numbers. 


The RSA process is: 
1. Initialization 


(a) Bob randomly selects two large primes p and q, with p 4 q. 

(b) The values n = pq and ¢ = ¢(n) = (p—1)(q—1) are computed, where 
¢ is Euler’s totient function. 

(c) Bob selects an integer e with 1 < e < dand GCD(e, ¢) = 1. 

(d) Bob computes the integer d such that 1 < d < ¢ and ed = 1 (mod ¢). 
(This can be achieved with the Euclidean algorithm.) 

(e) Bob publishes the values (n, e) and keeps the value of d secret. 


2. Use 


(a) Alice wants to send the plaintext number / to Bob. 

(b) Alice computes the ciphertext £ = M® (mod n) and sends it to Bob. 

(c) Bob accepts E and computes E4 (mod n) = M“* (mod n) = M 
(mod n); thus recovering the plaintext message. 
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10.9 DISCRETE DYNAMICAL SYSTEMS AND 
CHAOS 


A dynamical system described by a function f : M — M is chaotic if 


1. f is transitive—that is, for any pair of non-empty open sets U and V in M 
there exists a positive constant k such that f*(U) M V is not empty (here 


f* = fofo---o f);and 


2. The sevibdic points (the points that map to themselves after a finite number of 
iterations) of f are dense in 7; and 

3. f has a sensitive dependence on initial conditions—that is, there is a positive 
number 6 (depending only on f and /) such that in every non-empty open 
subset of M there is a pair of points whose eventual iterates under f are sepa- 
rated by a distance of at least 6. 


Some systems depend on a parameter and become chaotic for some values of that 
parameter. There are various routes to chaos, one of them is via period doubling 
bifurcations. Let the distance between successive bifurcations of a process be dx. 
The limiting ratio 6 = limg_,.. dx /dx41 is constant in many situations and is equal 
to Feigenbaum’s constant 6 ~ 4.6692016091029. 
Some chaotic one-dimensional maps are: 
1. Logistic map: p41 = 4¢p(1 — a) with xo € 0, 1]. 
Solution is z, = — — — cos[2” cos~*(1 — 2z9)]. 
2. Tent map: %41 = 1-2 |i - 3| with ao € [0, 1]. 
Solution is 2, = — cos~'[cos(2"72z9)]. 
T 
3. Baker transformation: 2,41; = 2x, (mod 1) with zo € [0,1]. 


Solution is z, = — cot~*[cot(2"729)]. 


T 


Chaotic differential equations include: #+a#—«#?+x = 0 for 2.0168 < a < 2.0577 
and # + x3 = sin Nt for most of the range 0 <  < 2.8. 


10.9.1 ERGODIC HIERARCHY 
The ergodic hierarchy is a classification of dynamical systems: 
Ergodic D Weak Mixing D Strong Mixing 5 Kolmogorov D Bernoulli (10.9.1) 


with a precise technical definition for each of the five levels. The higher up levels 
are “more random,” with a Bernoulli System being “completely random.” It may be 
that Strong Mixing is a necessary condition for a system to be chaotic, and being a 
Kolmogorov System is a sufficient condition for a system to be chaotic. 
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10.9.2 JULIA SETS AND THE MANDELBROT SET 


Consider the complex points {z,,} formed by iterating the map 2,41 = 22 + ¢ with 
zo = z. For each z, either the iterates remain bounded (z is in the prisoner set) 
or they escape to infinity (z is in the escape set). The Julia set J, is the boundary 
between these two sets. Using lighter colors to indicate a “faster” escape to infinity, 
Figure 10.1 shows two Julia sets. One of these Julia sets is connected, the other is 
disconnected. The Mandelbrot set, /, is the set of those complex values c for which 
J, is a connected set (see Figure 10.2). Alternately, the Mandelbrot set consists of 
all points c for which the discrete dynamical system, zn+1 = 22 +cwith z = 0, 
converges. 

The boundary of the Mandelbrot set is a fractal. There is no universal agreement 
on the definition of “fractal.” One definition is that it is a set whose fractal dimension 
differs from its topological dimension. 


FIGURE 10.1 
Connected Julia set for c = —0.51 (left). Disconnected Julia set for c = —3(1 + 1) (right). 
(Julia sets are the black objects.) 





FIGURE 10.2 
The Mandelbrot set. The leftmost point has the coordinates (—2,0). 
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10.9.3 LOGISTIC MAP 


Consider un+1 = f(Un) = aun(1 — un) with a € [0,4]. Note that if 0 < uo < 1 
then 0 < un < 1. The fixed points satisfy u = f(u) = au(1 — u); they are u = 0 
and u = (a—1)/a. 


. Ifa=Othenu, = 0. 

.fO<a<1thenu, > 0. 

.Ifl<a< 3 then un > (a—1)/a. 

. If3 <a < 3.449490... then wu, oscillates between the two roots of 
u = f(f(u)) which are not roots of u = f(w), that is, 

ut = (a+ 14 Va? — 2a — 3)/2a. 


BWNFR 














The location of the final state is summarized by the following diagram (the horizontal 


axis is the a value). 
1 





0.9 
0.8+ ‘ 
07+ : 

: 
0.6+ . 
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Minimal values of a at which a cycle with a given number of points appears: 


3.449490... 
3.544090... 
3.564407... 
3.568750... 


3.56969... 
3.56989... 
3.569934... 
3.569943... 
3.5699451... 
3.569945557... 
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10.10 ELLIPTIC CURVES 


Consider the general cubic curve Ax? + Ba?y + Cry? + Dy? + Ex? + Fry + 
Gy? + Hx + Iy + J = 0 overa field F. By an appropriate change of variables the 
curve can be simplified: 





e If F has characteristic 2, to y? + ay = 2° + Bx? + cay + dx +e. A commonly 
considered special case is (here b £ 0) 


yi tay=a2?+ar7+b (10.10.1) 


e If F has characteristic 3, to y? = x? + ax? + br +. 
e If F has characteristic not equal to 2 or 3 (e.g., F' is R or C) to 


yi =a? +ar+b (10.10.2) 


The graph of Equation (10.10.2) is symmetric about the x-axis, see Figure 10.3 
for different values of a and b. 


FIGURE 10.3 
The elliptic curve y* = «* + ax + b for different values of a and b. 
yi =a? -1 y=24+1 y? =2°— 3243 y? =a? —4e 














A curve F(x, y) = 0 is singular if there are any points with = =0= ae 
Equation (10.10.2) will be non-singular if the curve’s discriminant, —16(4a°+27b7), 
is non-zero. In this case the curve does not have repeated roots. 

The points on an elliptic curve can form an Abelian group if the curve is non- 
singular. There also needs to be a point at infinity indicated by oo; it is the group 
identity. The group’s binary operation is called addition, denoted “+.” Two points 


Py = (a1, y1) and Py = (x2, y2) can be added, P, + P2 = P3 = (x3, y3), as follows: 
e If P, = w then P3 = 0+ Py = Py. 
e If P, = —P> then P3 = ~w. 
e Otherwise, for Equation (10.10.2) 





- If x1 # v2 then \ = oS ts = \? — 24 — 22, and y3 = A(a1— #3) —Y1- 
-IfP, = Pp» and y; = 0 then P3 = oo. 

2 
— If P, = Pp and y; # 0 then \ = 24**, x3 = ? — Qa, and 


2y1 
Yo = Alay = 23) = yr. 
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e Otherwise, for Equation (10.10.1) 
— If, # x2 then \ = a as =)M+A+a, +22 +a, and 
Y3 = N(a1 + x3) + v3 Y1- 
- If P; = P» then \ = ey + 2, ts => M+A+Aa, and y3 = x? +(A+1)23. 








Addition can be understood geometrically: a line is drawn through P; and P2. Either 
this line does not intersect the curve and the result is oo, or it does intersect the curve. 
If the line does intersect the curve, then reflect the point of intersection about the x- 
axis (i.e., change the sign of the y term); this results in P3. See Figure 10.4. 


FIGURE 10.4 
Addition of two points on an elliptic curve. Distinct points (left, R = P + Q) and the same 


point (right, R= P+ P= 2P). 








y y 
ZA . 
is . 
Pe cs 
wo ft x 4 
Q = (@2,y2)_-}° ; f H P= (21,91) fo 
aa | ia | 
t —S - =r . - z 
Nee a i iy / \ I 
2 I ~ 1 
P= (i,m) ‘ ! \ 
\ ! \ i 
he me od 
No Ke 
= ¥ an 1 
Wk = (wa, ys) eR = (ra, ys) 


Now assume that the field F’ is not the real numbers (as implicitly assumed 
above) but of finite order; for example, F;, for a prime p. If the determinant of 
the curve is non-zero (modulo p) then the points form a group, as before. (The 
computation of \ in the addition formulas is then taken modulo p.) 


EXAMPLE 


Consider the points on the curve 
y? = x* — 1 over the field Fy7. 
There are 17 such points: 

{..., (3, 3), (3, 14), (7, 6), 
(7,11), (8,1), (8, 16),...}. 
Note that the points are 
symmetric about the line y = 8.5. 











EXAMPLE 
Use the field F2m with 2”” elements and use the elliptic curve in Equation (10.10.1). 
For example, consider y? + ay = «° + g*x? + 1 over the field F,4, where g is a 
multiplicative generator of Fy4 satisfying g* = g + 1. The 15 points on this elliptic 
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curve are: (1,9°), (1,9°"°), (g°,9°"°) (9°,9°), (g)9-). (g°,9°)) (9°, 9°"): 

(9°,9°), (9°,9°°), (99,97), (9°°,.9°), (9°, 9), (9°, 9"), (g"?, 00), and (00, 1). 

Scalar “multiplication” of an integer k by the elliptic curve point P, to obtain 

a new elliptic curve point, is achieved by the “double and add” algorithm. That is: 

2P = P+ P,3P = (2P) + P,4P = (2P) + (2P), 5P = (4P) + P, etc. The 

discrete logarithm for elliptic curves is to determine k when given P and k P. Elliptic 
curve cryptography (ECC) schemes exploit the difficulty of the logarithm problem. 


e Key exchange is a process by which Alice and Bob secretly determine a key 
that others cannot determine. The process is: 


1. Alice and Bob agree on an elliptic curve to use, a finite field F’, an initial 
point Po, and a process for creating a secret key from an elliptic curve 
point (e.g., given P = (x, y) the key could be x). 

2. Alice selects a secret number A, creates P4 = AP», sends P, to Bob. 

3. Bob selects a secret number B, creates Pg = BPo, sends Pp to Alice. 

4. Alice accepts Pg and computes P4p = APg = ABP). 

5. Bob accepts P4 and computes Pap = BP, = ABP. 

6. Alice and Bob create the same secret key from P4p. 


Due to the difficulty of the logarithm problem, an observer who knows the 
elliptic curve used and {F', Po, Pa, Ps} will not be able to easily determine 
Pp and the resulting secret key. 


The key exchange algorithm above is the basic Diffie-Hellman key exchange 
done over an Elliptic Curve group. The more common approach is to use 
Diffie-Hellman key exchange over a multiplicative group. In this method two 
numbers are made public: p (a prime) and g (a primitive root modulo p). Alice 
selects a secret number A, creates a = ge (mod p), and sends this to Bob. 
Bob selects a secret number B, creates 6 = go? (mod p), and sends this to Al- 
ice. The secret key is then K, computed by Alice as K = 84 (mod p) = g4? 
(mod p) and computed by Bob as K = a? (mod p) = g4? (mod p). 
e Secure communication (El-Gamal process) 

Alice and Bob agree on an elliptic curve to use, a finite field F’, an initial point 
Po, and a process for converting between a number and an elliptic curve point 
(e.g., given P = (x, y) the value could be z). 


1. Initialization 
Bob selects a secret number B, creates Pg = BP, sends Pz to Alice. 
This can be used for many messages. 

2. Encryption 
Alice wants to send a message z, which maps to the point P, on the elliptic 
curve, to Bob. Alice selects a secret number A and creates the pair of 
values (21, z2) = (APo, P. + APg) and sends them to Bob. 

3. Decryption 
Bob accepts the pair of values (21, z2) and determines the point sent via 
22° Bz = (P: + APp) = B(AP) => P3 + (ABP, = BAP) => Ps. 
From P, the message z can be determined. 
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10.11 FINANCIAL FORMULAS 


10.11.1 BORROWING AND LENDING 

Notation 

amount that P is worth, after n time periods, with 2 percent interest per period 
total amount borrowed 

principal to be invested (equivalently, present value) 

future value multiplier after one time period 

percent interest per time period (expressed as a decimal) 

amount to be paid each time period 

number of time periods 


3.3 3. 9  ~ op 


Note that the units of A, B, P, and m must all be the same, for example, dollars. 


10.11.1.1. Formulas connecting financial terms 


1. Interest: Let the principal amount P be invested at an interest rate of 7% per 
time period (expressed as a decimal), for n time periods. Let A be the amount 
that this is worth after n time periods. Then 


(a) Simple interest: 


A 1/A 

A=P(1+ni) and P= (1+ ni) and i= 5 \ Pp 1 

(10.11.1) 

(b) Compound interest 
1/n 
saPidar waa Pa — oat G(s) Ht, 
(1 +i)” P 
(10.11.2) 


When interest is compounded g times per time period for n time periods, 
it is equivalent to an interest rate of (¢/q)% per time period for ng time 


periods. 
-\ ng 
A=P (1 re ~) 
q 


a 
p=a(t c ~) ; (10.11.3) 


ay 


Continuous compounding occurs when the interest is compounded in- 
finitely often in each time period (i.e., g > oo). In this case: A = Pe'”. 





1=q 





2. Present value: If A is to be received after n time periods of 1% interest per 
time period, then the present value P of such an investment is given by (from 
Equation (10.11.2)) P = A(1+i)~”. 
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3. Annuities: Suppose that the amount B (in dollars) is borrowed, at a rate of 7% 
per time period, to be repaid at a rate of m (in dollars) per time period, for a 
total of n time periods. 





. (+) 
=B 10.11.4 
mS ONT Ea? = 1 
m 1 
B=—{|1-—— }. 10.11.5 
( (+ x) oe 
Using a = (1 +7), these equations can be written more compactly as 
. a” m 1 
m= Bi and B= (1 = =) : (10.11.6) 
a” —1 a a” 


10.11.1.2 Examples 


1. Question: If $100 is invested at 5% per year, compounded annually for 10 
years, what is the resulting amount? 
e Analysis: Using Equation (10.11.2), we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Time period, 1 year 
(c) Interest rate per time period, i = 5% = 0.05 
(d) Number of time periods, n = 10 


e Answer: A = P(1 +7)” or A = 100(1 + 0.05)!° = $162.89. 


2. Question: If $100 is invested at 5% per year and the interest is compounded 
quarterly (4 times a year) for 10 years, what is the final amount? 


e Analysis: Using Equation (10.11.3) we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Time period, 1 year 
(c) Interest rate per time period, i = 5% = 0.05 
(d) Number of time periods, n = 10 
(e) Number of compounding time periods, g = 4 


e Answer: A= P(1+ :) " or A = 100(1 + 298)419 = 100(1.0125)° 
= $164.36. 

e Alternate analysis: Using Equation (10.11.2), we identify 
(a) Principal invested, P = 100 (the units are dollars) 
(b) Time period, quarter of a year 
(c) Interest rate per time period, 1 = a 
(d) Number of time periods, n = 10-4 = 40 

rA= 


e Alternate answer: A = P(1 +i)” 0 00(1.0125)*° = $164.36. 
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3. Question: If $100 is invested now, and we wish to have $200 at the end of 10 
years, what yearly compound interest rate must we receive? 


e Analysis: Using Equation (10.11.2), we identify 
(a) Principle invested, P = 100 (the units are dollars) 
(b) Final amount, A = 200 
(c) Time period, | year 
(d) Number of time periods, n = 10 

e Answer: i = (ay —lori= (2002/20 — 1 = 0.0718. Hence, we 

must receive an annual interest rate of 7.2%. 

4. Question: An investment returns $10,000 in 10 years. If the interest rate will 

be 10% per year, what is the present value? (That is, how much money would 


have to be invested now to obtain this amount in 10 years?) 


e Analysis: Using Equation (10.11.2), we identify 
(a) Final amount, A =10,000 (the units are dollars) 
(b) Time period, 10 years 
(c) Interest rate per time period, i = 10% = 0.1 
(d) Number of time periods, n = 10 
e Answer: P = A(1 +i)~” = 10,000(1.1)~1° = 3855.43; the present 
value of this investment is $3,855.43. 


5. Question: A mortgage of $100,000 is obtained with which to buy a house. 
The mortgage will be repaid at an interest rate of 6% per year, compounded 
monthly, for 30 years. What is the monthly payment? 

e Analysis: Using Equation (10.11.6), we identify 
(a) Amount borrowed, B = 100, 000 (the units are dollars) 
(b) Time period, 1 month 
(c) Interest rate per time period, i = 0.06/12 = 0.005 
(d) Number of time periods, n = 30- 12 = 360 
e Answer: a = 1 +7 = 1.005 and m = Bix, = (100, 000)(.005) 


x 61.005)° 599.55. Th thi tis $599.55 
T1.005)250—1 .59. The monthly payment is 55. 


6. Question: Suppose that interest rates on 15-year mortgages are currently 6%, 
compounded monthly. By spending $800 per month, what is the largest mort- 


gage obtainable? 

e Analysis: Using Equation (10.11.6), we identify 
(a) Time period, 1 month 
(b) Payment amount, m = 800 (the units are dollars) 
(c) Interest rate per time period, i = 0.06/12 = 0.005 
(d) Number of time periods, n = 15 - 12 = 180 

e Answer: 
a=1+i= 1.005 and B = m(1—1/a")/i = oe (1 — pe) 
= 94802.81. The largest mortgage amount obtainable is $94,802.81. 
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10.11.2 OPTIONS 


Notation 
e S asset (spot) price e o volatility of the asset 
e V value of an option e 7 time to asset maturity 


e r risk free interest rate 


First order effects 














1. Delta A= 35 — change in value with respect to price 
OV 2 : : ‘ 
2. Lambda A = 3S x — =change in value (%) with respect to price (%) 
OV . : ‘ 
3. Rho p= a change in value with respect to interest rate 
Tr 
OV : : 
4. Theta O= a change in value as time changes 
Tr 
OV : : in 
5. Vega v= aa 7 change in value with respect to volatility 
o 
Second order effects 
OA 0o 0?V Op OPV 
1. Ch — =-—= 4. V eS 
Charm — 3, ~~ 9s Sr" 8a — Badr 
OA OV OV 0?V 
Soe — ag. eee a 2 Baer 
OA Ov 6?V Ov OPV 
> Vanna a5 aS asda 89 “MMA a = 862 
Third order effects 
or OV O(vomma) 0°V 
1. Col —_— == . Ulti ——___—__ = —_— 
Color Or — OS? 7 arn do3 
Or =O8V or _ Ovanna) OV 
2. Speed — = — 4. Z Sa 
Pee’ aS as? oe Oa~SC«SSSt*S*«CS2 DT 


10.11.2.1 Values for a European option 


Here 
e ee =e ®/2 p 27 is the standard normal density function 
e B(x) eee z) dz is the standard normal cumulative distribution function 
d 


dy = BLE K)4 ne ne /2)r 





e do = nee ai a7 /2)r age ot 
e K is the strike price 
e gis the annual dividend yield 
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Call values 


value Se %®(d,)-—e '’ K®(d2) 


First order effects 


delta e 27 ®(d1) 


rho Krte "’ ®(d2) 
S@ dy oO _ 
2/T 


theta —e %7 rKe-"’®(d2) + qgSe 7 ®(d;) 


vega Se~" (di) V7 = Ke7"" (da) VT 
Second order effects 


charm ge 27 ®(d,) — e~ 9" d(d,) 2(r- on — dao./T 
TOT 


gamma e 


vomma Se~%7$(d)/T—— =v 
Third order effects 


Qqr +1 + +d, 
oO 


_ Te ‘a 
d d d 


ultima ——— [dido(1 — dida) +d} + d3] 


So2\/T o 


Put values 
The Put values are the same as the Call values for: vega, gamma, vanna, veta, 
vomma, speed, zomma, color, and ultima. 


value e '’ K®(—d2) — Se" ®(—d;) 
First order effects 


delta —e ? @(—d;) 


rho —Kre-"’ ®(—d2) 





theta —e 


qr S@ dy, Oo 
2 


= 
Second order effects 


—rKe~"? ®(da) + qSe~" ®(d;) 


Wr—qyr—d 
charm —ge~#" ®(—dy) — ed) = — 0 PV 





2T0.1/T 
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10.11.3 | MODERN PORTFOLIO THEORY 


There are assets {1,2,...}; a collection of them will be purchased for a portfolio. 


e Asset 2 has arandom return A; with mean 7; and variance a. 


e The covariance of the random returns, for assets 7 and j, is 0;; = 040; :;. Here 
Piz is the correlation coefficient and p;; = 1. 


. : . T 
A portfolio contains w; of asset 7. Define the return vector r = [ri TQ «e | , the 


‘ : ; T 
covariance matrix L = (o%;), and the weight vector w = [wi wa .. | : 


1. The random portfolio return is R, = y wiAj 
2. The portfolio’s expected return of E[R,] = >, wiE [Ai] = 0, wri = w'r 
2 


3. The portfolio’s variance is Var [Rp] = 0, = 30; 0; WiWjoij = ww 


4. The portfolio has a volatility of o, = Og: 
Define the risk tolerance g > 0; if g = 0 then no risk is acceptable, if q is large then 
a large amount of risk is acceptable. The portfolio optimization problem is to solve 


the quadratic programming problem: 
ee T T 
minimizey w Uw-qwr 


subject to ». w;,=1 (the initial portfolio value is fixed) 


If the solution has any w;, < 0 it means that asset / has been shorted. To avoid short- 
ing assets, include the constraint w; > 0 for? = 1,2,... in the problem statement. 


10.11.4 MERTON’S PORTFOLIO PROBLEM 


You need to determine how much of your wealth to consume today, and how much 
to keep for investment. The goal is to maximize the value of the your utility, out to 
infinite time. Assume 


w(t) is your wealth at time t; which evolves stochastically 

c(t) is the amount consumed at time t (where c(t) < w(t)) 

u(c) is your utility function; when consuming c 

p is your subjective discount rate (consuming now is better than later) 
(4, 07) are the mean and variance for stocks with a random return 

a(t) is the fraction of your wealth in stocks; the rest is in risk-free assets 
r is the return for a risk-free investment 


Soy Sr Pee 


The problem statement is to maximize E | he e~*'u(c(t)) dt]. If your utility func- 
saath re — 
tion is u(x) = , which represents constant relative risk aversion parametrized 





by ¥, then z(t) = z ; “a constant. 
ory 
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10.11.5 DOUBLING TIME - THE RULE OF 72 

The “rule of 72” is an approximation for how long it takes the value of money to 
double. The computation is simple: divide the yearly interest rate into the number 
72, the result is a number of years needed. The value 72 is used since it has many 
small divisors (e.g., 2,3,4,6,8); the value 69 would be more accurate. 


EXAMPLE Investing $100 at an annual interest rate is 9%, it will take 2 ~ 8 years for 
the money to double to $200. (The actual return is (1.09)* = $199.26 ~ $200.) 


10.11.6 CONTINUOUS COMPOUNDING 

For a nominal annual rate r the effective annual interest rate under continuous com- 

pounding is y = e” — 1. 

EXAMPLE Consider the final amount F for an investment X using a nomimal interest 
rate of r = 8% and different compounding periods: 








1. compounded quarterly: F = X(1+ 0.08243) = X (1+ y- 
2. compounded monthly: F = X(1+0.08300) = X (1+5 a 
3. compounded continuously: F' = X(1+ 0.08329) = X(1+y) = Xe’ 


10.11.7 ECONOMIC ORDER QUANTITY FORMULA 
e A order cost (dollars per order) e H holding cost (dollars per item) 
e D demand rate (pieces per unit time) e Q order quantity (pieces per order) 


: soa ie * — ,/ 24D 
The optimal order size is Q* = 4/== 


10.11.8 FINANCIAL TABLES 
10.11.8.1 Compound interest: find final value 


The following table uses Equation (10.11.2) to determine the final value in dollars 
(A) when one dollar (P = 1) is invested at an interest rate of 7 per time period, the 
length of investment time being n time periods. 

For example, if $1 is invested at a return of 3% per time period, for n = 60 time 
periods, then the final value would be $5.89. Analogously, if $10 had been invested, 
then the final value would be $59.92. 

3% 4% 5% 6% 7% 8% 9% 10% 
1.082 1.103 1.123 1.145 1.166 1.188 1.210 
1.170 1.216 1.263 1.311 1.361 1.412 1.464 
1.265 1.340 1.419 1.501 1.587 1.677 1.772 
1.369 1.478 1.594 1.718 = 1.851 1.993 2.144 


1.480 1.629 1.791 1.967 2.159 2.367 2.594 
1.601 1.796 2.012 2.252 2.518 2.813 3.138 
2.191 2.653 3.207 3.870 4.661 5.604 6.728 
2.563 3.225 4.049 5.072 6341 7.911 9.850 
4.104 5.792 8.147 11.424 15.97 22.25 30.91 
6.571 10.40 16.39 25.73 40.21 62.59 97.02 
10.52 18.68 32.99 57.95 101.26 176.03 304.48 
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10.11.8.2 Compound interest: find interest rate 


The following table uses Equation (10.11.2) to determine the compound interest rate 
2 that must be obtained from an investment of one dollar (P = 1) to yield a final 
value of A (in dollars) when the initial amount is invested for n time periods. 

For example, if $1 is invested for n = 60 time periods, and the final amount 
obtained is $4.00, then the interest rate was 2.34% per time period. 


Return after investing $1 for n time periods (A) 
n| $2.00 $3.00 $4.00 $5.00 $6.00 $7.00 $8.00 $9.00 $10.00 
100 30 


500 600 700 800 900 
144 164 182 200 216 
81.7 91.3 100 108 115 
56.5 62.7 68.2 73.2 77.8 


43.1 476 516 55.3 58.5 


196 21.5 23.1 24.6 25.9 
16.1 176 189 20.1 21.2 
9.37 10.2 11.0 11.6 12.2 
7.75 845 9.05 9.59 10.1 
5.10 5.55 5.95 6.29 6.61 
3.80 414 443 4.68 4.91 
3.03 3.30 3.53 3.73 3.91 





10.11.8.3 Compound interest: find annuity 


The following table uses Equation (10.11.4) to determine the annuity (or mortgage) 
payment that must be paid each time period, for n time periods, at an interest rate of 
4% per time period, to pay off a loan of one dollar (B = 1). 

For example, if $100 is borrowed at 3% interest per time period, and the amount 
is to be paid back in equal amounts over n = 10 time periods, then the amount paid 
back per time period is $11.72. 


n 2% 3% 4% 5% 6% 1% 8% 9% 10% 
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10.12 GAME THEORY 


10.12.1_ TWO PERSON NON-COOPERATIVE MATRIX GAMES 


Given matrices A = (a;;) and B = (b;;) consider a game played as follows: Alice 
chooses action 7 (out of n possible actions) and Bob chooses action 7 (out of m pos- 
sible actions). The outcome of the game is (7, 7) and Alice and Bob receive payoffs 
of a;; and 6;;, respectively. If using a mixed or random strategy, then Alice selects 
x’ = (x1, 2,...,2n) where x; corresponds to the probability that she chooses ac- 
tion i and Bob selects y’ = (y1, yo,---, Ym) where yj corresponds to the probability 
that he chooses action 7. Each player seeks to maximize their average payoff; Alice 
wants to maximize x! Ay while Bob wants to maximize x! By. 

If aj; < aj«; for all 2 and 7 then 2* is a dominant strategy for Alice. Similarly, if 
bi; < bi;* for alli and j then j* is a dominant strategy for Bob. An outcome (2*, j*) 
is Pareto optimal if, for all 7 and J, the relation a;+j« < ai; implies bj+j- > b;;. 

If A+ B = 0 then the game is a zero sum game and Bob equivalently is trying 
to minimize Alice’s payoff. If A+ B 4 0 then the game is a non-zero sum game and 
there is potential for mutual gain or loss. 

A pure strategy is one with no probabilistic component. 


10.12.1.1 The pure zero sum game 


Assume a zero sum game, A+ B = 0. The outcome (i, 9) i is an equilibrium if 


eae ans ~< aR; for all 2 and 7. (Note that this implies b;; < bez <b Z) 


“ If G j) is an equilibrium then max; min; aj; = min; max; aj; = az 7. 

2. For all A, max; min; ajj < min; max; aj;. 

3. For all A, all outcomes are Pareto optimal as ans < Gig implies 
bee = —ag> > —aaz = diy. 

4. For some A, there will be no equilibrium. For example, if A = [5 7 | then 
1 = max; min; aj; < min; max; aj; = 2. 

5. For some A, there will be an equilibrium which is not a dominant strategy. For 
example, if A = [3 +], then outcome (1,1) is an equilibrium with the property 
that Alice has the dominant strategy 7 = 1 as ay) > a2,; and aj,2 > a2,9, but 
there is no dominant strategy for Bob as a1; < aj,2 but ag) > ag9. 

6. For some A, there will be multiple equilibria. If (1, 71) and (¢2, j2) are each an 
equilibrium then (71, j2) and (i2, 71) are also equilibria. For example, if A = 


[21 I 2] then the outcomes (1,1), (1,3), (3,1) and (3,3) are each an equilibrium. 


7. Order of actions: If Alice chooses her action before Bob and she chooses 2 
then Bob will choose action $(i) = arg min, a;;. Hence Alice will choose 
i= arg max; Qjg(;) = arg max; min; a;; which is the maximin strategy. Al- 
ternatively, if Bob chooses his action before Alice he will choose the minimax 
strategy 7 = argmin; max; a;;. A player should never prefer to choose an 
action first but if there is an equilibrium the advantages of taking the second 
action can be eliminated. 
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10.12.1.2 The mixed zero sum game 


The outcome (x, y) is an equilibrium for the mixed zero sum game if 
xAy <x AV <x Ay  forallx € S, andally € S, 
where S, = {x|0 < a and )), 2; = 1} and Sy = {y| 0 < yj and >), yj = 1}. 


1. If (x,y) is an equilibrium then 
max min x! Ay = min maxx! Ay =X" AJ. 
x€Sa yESy yeSy x€Sz 
2. For all A, there exists at least one mixed strategy equilibrium. If there is 
more than one equilibrium, the average payoff to each player is independent 
of which equilibrium is used. 
3: ..1f min; yee ii; < min; ; Lida; for all x € Se and max; ea QijUy 
max; )), aij¥j for all y € Sy then (x,y) is an equilibrium. 
4. If A > 0 then an equilibrium strategy for Alice solves max, v subject to v < 
>, viaiz for all j, with 0,2; = 1 and a; > 0. The optimal value of v 
corresponds to the average payoff to Alice in equilibrium. If a, = 2; /v this is 


Heine 
5 U4; 
/ 
x > 0, 


IV 


>1, forall 7, 


Bn ste. 2 na i 
minimize x’, subject to 
d, : : for all i. 


Similarly, if y’ = (y/,...,y/,) is a solution to 


e aigy; <1, for all z, 


maximize > yj subject to y >0, forall j 
7 J = ‘ , 


J 


theny=y'/>> ; Yj is the equilibrium strategy for Bob. The payoff to Alice in 
equilibrium is v = 1/57; 2, = 1/0, yj. For example, if A = [5 7] then 


wv, + 2x5 > 1, x, >0 


Pe . / / : 
minimize x; + £, subject to 
nes) een wr, > 0 
has the solution x, = 7, = z. The payoff to Alice in equilibrium is 3 and the 
equilibrium is (21,72) = (3,4). 
5. If Ais 2 x 2 and a11 < 41,2, @1,1 < G21, d2,2 < G21, and a2.2 < @1,2 (so 
neither player has a dominant strategy) then the mixed strategy equilibrium is 


— a2,1 — 42,2 41,2 — 41,1 ) 
a1,2 + @2,1 — a1,1 — 42,2 G12 +421 — a1,1 — 42,2) — 


jy = a1,2 — 42,2 a2.1 — 41,1 ) 
= §| ————— 
1,2 + 42,1 — 41,1 — 42,2 41,2 + 42,1 — 41,1 — 42,2 


@1,242,1—41,142,2 
a1,2+@2,1—@1,1—42,2 


max min », jaijY; = min max >> = Lid; (10.12.2) 
ij ij 


XESz YESy yESy XES, 


(10.12.1) 








and the payoff to Alice in equilibrium is . which is 
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For example, if A = [4 ?] then the solution is X = y = (4, 4) and the payoff 
to Alice in equilibrium is 3. 


. Order of actions: It is never an advantage to take the first action. However, 


if the first player uses a mixed strategy equilibrium, then the advantages of 
taking the second action can always be eliminated. 


10.12.1.3. The non-zero sum game 

The outcome (ij) is a Nash equilibrium if az < az for all i and b;, < b7 for all 7. 
For the mixed strategy game the outcome (x, y) is a Nash equilibrium if 

x’ Ay < x Ay for all x € S, andX' Ay < X' Ay far ally € Sy. 


ie 
2. 


For all A and B, there exists at least one mixed strategy Nash equilibrium. 
For all A and B, max; a aig Yj < a yj Lidiz Yj and max; y; £ibi; < 
Yi DL; Tidiz¥j is a necessary and sufficient condition for (x,y) to be a Nash 
equilibrium. For example, if A = [{4] and B = [?}] then there are three 
Nash equilibra: (i) {x = (0,1), y = (0, 1)}, (i) {x = (3, 2),y = (2, 2)}. and 
(iii) {x = (1, OM = (1, O)}- 


. For all A and B, if yy aig Yj is a constant for all 7 and ye x;bi; is a constant 


for all 7 (i.e., each player chooses an action to make the other indifferent to 
their action) then (x,y) is a Nash equilibrium. 


. For some A and B if (#1, 71) and (22, j2) are each a (pure strategy) Nash equi- 


librium then, unlike the case for a zero sum game, a;,;, need not equal aj;,5,, 
b;,;, need not equal b,,;,, and neither (i, j2) nor (i2, 71) need be a Nash equi- 
librium. For example, if A = [+3] and B = [} }] then both of the outcomes 
(1,1) and (2,2) are Nash equilibra yet neither (1,2) nor (2,1) are Nash equilibra. 


. Prisoners’ Dilemma: A game in which there is a dominant strategy for both 


players but it is not Pareto optimal. For example, if A = [{2 2] and B = 
[19 12] then the dominant (and equilibrium) outcome is (2,2) since a2; > a1; 
for all j and and bj2 > bj; for all 7. Here, Alice and Bob receive a payoff of 
5 although the outcome (1,1) would be preferred by both because each would 
receive a payoff of 10. 


. Braess Paradox: A game in which the Nash equilibrium has a worse payoff for 


all players than the Nash equilibrium which would result if there were fewer 


. : : 10 2 1 10 15 20 
possible actions. For example, if A = [8 5 2] and B = 25 é | then 


the Nash equilibrium is (3,3) which is worse for both players than the Nash 
equilibrium (2,2) which would occur if the third option for each player was 
unavailable. 


. Order of actions: If Alice chooses action 7 before Bob chooses an action, 


then Bob will choose 6(i) = arg max, b;; and hence Alice will choose i = 
arg max; @;g(;)- Alternatively, if Bob chooses an action before Alice, he will 
choose 7 = arg max; ba(j)j where a(j7) = argmax;a;;. Unlike the zero 
sum game there might be an advantage to choosing the action first, e.g., for 
A = [43] and B = [#4] if Alice is first, the outcome will be (1,1) with a 
payoff of 4 to Alice and 3 to Bob. If Bob is first the outcome will be (2,2) with 
a payoff of 4 to Bob and 3 to Alice. 
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10.13 KNOT THEORY 


1. A knot is a closed, non-self-intersecting curve that is embedded in three di- 
mensions and cannot be untangled to produce a simple loop (i.e., the unknot). 
Knots do not exist in higher-dimensional spaces. 

2. Each place in a knot where 2 strands touch and one passes over (or un- 
der) the other is called a crossing. The number of crossings in a knot is 
called the crossing number. Let N(n) be the number of distinct prime knots 
with n crossings, counting chiral versions of the same knot separately. Then 
3 (2% 7-1) < N(n) Se”. 

[ Number of knots with crossings | 1 1237 21 49 165552 

3. The traditional Alexander—Briggs notation for a knot (e.g., 31, 41, 52) 1s the 
number of crossings with a subscript. The subscript starts at | and counts the 
number of knots with that many crossings; the order is arbitrary. 

4. The unknot, or trivial knot, is a closed loop that is not knotted. 

5. The trefoil knot, or 3, knot or overhand knot, has three crossings. 

6. The square knot is the knot sum of two trefoils with opposite chiralities: 
317¢3}. The granny knot is the knot sum of two trefoils with the same chi- 
rality: 314£31. The knot sum operation is denoted #. Two knots are summed 
by placing them side-by-side and joining them by straight bars so the orienta- 
tion is preserved in the sum; this is not a well-defined operation as it depends 
on the representation. The knot sum of two unknots is another unknot. 

7. There are many knot representation schemes, including Alexander poly- 
nomials (A(a)), Conway polynomials (C(x)), and HOMFLY polynomials 
(P(é,m)). The left and right trefoil knots have the same Alexander poly- 
nomials and different HOMFLY polynomials. 


8. Some knot representations use skeins (see figure ae x 
to right) to recursively simplify a knot. For exam- XxX YC D 
ple, the Conway polynomial of a knot may be de- 
LE Lo Ly 


termined by C (L,) = C (L_) + «C (Lo) with 
C(unknot) = 1. 
9. Information about the simplest knots: 





\ Ye ' oe ) = 7 
Name: trefoil knot figure eight knot Solomon seal knot 
Notation: 31 44 54 
AT. °° »4x.«,. f Ll °°» -=l , S.. = oD fa. .=L. =. 
A(x): g—-l+z —a2'+3-—a2 2 -a+l—-a '+a-? 








P(l,m): -@4+m??-20 m?-(P +0741) mi +m?(-0 — 


4g*) + (30* + 20°) 
C(x): 1 1 


x): ae + —2 gt 3e + 1 





N 
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10.13.1 KNOTS UP TO EIGHT CROSSINGS 
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Image by Charlie Gunn and David Broman. Copyright The Geometry Center, Uni- 
versity of Minnesota. With permission. 
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10.14 LATTICES 


Let B = [bi bo ... bm] be a set of vectors in R”. If the {b,,} are independent, 
then points in R” can be written as linear combinations of the {b;,}: x = x TrDE 
where the {7;,} are real numbers. Now, instead, only allow integer coefficients: 


i » dy bx dy are ines 
k=0 


Then L is a lattice of dimension n and rank m. 

Given a lattice there are many bases that could be used to describe it. The goal 
of lattice basis reduction is to determine, from an integer lattice basis, a basis with 
“short,” nearly orthogonal vectors. 


The size of a vector is its Euclidean length: 

\|b||, = Vb'b. The size of the basis, in the full 

rank case, is the volume \/det(B'B). This is 

constant for a given lattice (up to sign) and is 

called the lattice constant. The figure shows a u 
lattice with basis V = [vi v2| and a “shorter” 

basis U = [ur uy]. 


EXAMPLE 
Consider the basis B = [} 4] = [bi ba] withb; = [1 9] and bs = [4 37)". 
Defining bj = bz — 4b; = [0 1]" and bs = bi — 9b, = [1 0] results in the 
basis B’ = [39] = [bi bs | with shorter vectors. Here the lattice constant is 1. 


Given the m x n integer matrix A there is the lattice L(A) = {y € R™ | y = 
Ax,x € Z"}. This lattice is said to be generated by the columns of A. Computational 
problems involving integer lattices are the following: 


1. Given an integral vector b, determine if b is in L(A). If b € L(A), determine 
b as an integral linear combination of the columns of A. This problem is called 
the linear equation integer feasibility problem. 

2. Given A and b, the closest vector problem is to _ find 
miny {|b — yl |b € L(A)} 

3. The shortest vector problem is the closest vector problem with b = 0 and the 
resulting vector being non-zero. That is, find min, {z | z € L(A),z 4 0}. 


It is difficult to determine the shortest vector for all bases. An approximate solution 

is obtained by the LLL (for Lenstra, Lenstra, and Lovasz) algorithm which runs in 

polynomial time. It outputs a short vector b‘, with ||b’ | cs gell* det( Ly, 
There are many applications of finding the shortest vector: 
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Given the value a = V17 — V'13, find a polynomial that has a as a root. 
If a satisfies a polynomial of degree p, then there is an integer relation among 


the values {1,a,a7,...,a?}. Choosing p = 4, consider the basis 
1 0 0 0 0 
0 1 0 0 0 
0 0 1 0 0 
B= 0 0 0 1 0 (10.14.1) 
0 O 0 0 1 
C Ca Ca? Ca® Cat 


where C is an arbitrary constant, the bigger the better. Using C = 10! 
evaluate B to 10 decimal places and then round the values to the near- 
est integer. Now B has integer values. This lattice has a shortest vector 
[16 0 -60 0 1 ~3]" suggesting that a is a solution of the polynomial 
16 — 60p” + p* = 0, which is correct. 

Suspecting that 8 = cot $+cot = +cot 2 is a linear combination of {1, V2}, 


1 0 0 
find that combination. Use the basis B = | 600° | , evaluate it numerically 
C CV2 OB 


for C = 107°, round to integer values, and then use LLL to find the shortest 
vector [-1 —2 1 o]". This suggests that cot + cot = + cot =1-+ 
2/2, which is correct. 


A oe Hf ay ag 
Suspecting that tT = > T6F ean =F Bk 42 igh + 3 + aI: find {aj}. 
Use the basis 
1 0 0 0 0 
0 1 0 0 0 
0 0 i 0 0 
B=): : oe = Meg (10.14.2) 
0 0 0 0 0 
0 0 0 0 1 
Cr Cy, Cy2 Cy... Cry 


where y; = aa seo. Use a large value of C' and proceed as before. In 
this case there are two short vectors ({-1 4 00 -2 -1 -1 0O 0] 
and [-2 0 8 4 4 0 0 -1 0]) suggesting: 


pe 
16k [8K +1 8kK+4 8K+5 8kK+6 
Zz (10.14.3) 


[oe} 


9 se 1 8 i 4 is 4 1 
T= =—= | SS ———_ a 
nerd 16* |8k+2 8k+3 8k+4 8k+7 





both of which are correct. 
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10.15 LOGIC 


10.15.1 SYMBOLIC LOGIC 
10.15.1.1 Propositional calculus 


Propositional calculus is the study of statements: how they are combined and how 
to determine their truth. Statements (or propositions) are combined by means of 
connectives such as and (A), or (V), not (=, or sometimes ~), implies (—), and if 
and only if (<—+, sometimes written <> or “iff’). Propositions are denoted by 
letters {p,q,r,...}. For example, if p is the statement “ax = 3,” and q the statement 
“y = 4,” then p V 7q would be interpreted as “x = 3 or y # 4.” To determine the 
truth of a statement, truth tables are used. Using T (for true) and F (for false), the 
truth tables for these connectives are as follows: 


pPA\q pVqd pq pq 


J 
s 





™ Hc 
47 


p 
T 
oe 
F 
F 


Aas 
Tam 4 
TMHAarA 
34m 
Hmmy 


The proposition p — q can be read “/f p then q’ or, less often, “q if p.’ The 
table shows that “p V q’ is an inclusive or because it is true even when p and q are 
both true. Thus, the statement “I’m watching TV or I’m doing homework” is a true 
statement if the narrator happens to be both watching TV and doing homework. Note 
that p — q is false only when p is true and q is false. Thus, a false statement implies 
any statement and a true statement is implied by any statement. 


10.15.1.2 Truth tables as functions 


If we assign the value | to T, and 0 to F then the truth table for p / q is simply the 
value pq. This can be done with all the connectives as follows: 


Connective | Arithmetic function 





pA pq 

PVG p+q- pg 
pq 1—p-+pq 
pi q 1—p—q-+ 2pq 
ap =p 


These formulas may be used to verify tautologies, because, from this point of view, 
a tautology is a function whose value is identically |. In using them, it is useful to 
remember that pp = p” = p, since p = 0 or p = 1. 
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10.15.1.3 Tautologies 


A statement such as (p + (gq A 1r)) V np is a compound statement composed of 
the atomic propositions p, q, and r. The letters P, Q, and FR are used to designate 
compound statements. A tautology is a compound statement which always is true, 
regardless of the truth values of the atomic statements used to define it. For example, 
a simple tautology is (=p) «—> p. Tautologies are logical truths. More examples: 


Law of the excluded middle pV 7p 
De Morgan’s laws =(p V q) <> (=p A 7g) 
a(p A q) <> (ap V 79) 
Modus ponens (pA (p>) > 4 
Contrapositive law (p > gq) <> (-q > 7p) 
Reductio ad absurdum (=p > p) > p 
Elimination of cases ((pV ¢) An7p) 
Transitivity of implication ((p—>q)A 
Proof by cases ((p>aq)A 


> 4q 
cso (p> r) 
(=p q))> 4 


Idempotent laws p\p— p; pV p+ p 


Commutative laws (pA q) <> (qAp); (pV ¢) <> (aV p) 
Associative laws (pA (¢Ar)) <> ((pAqg Ar) 
(pV (Vv r)) > ((pV a) Vr) 


10.15.1.4 Rules of inference 


A rule of inference in propositional calculus is a method of arriving at a valid (true) 
conclusion, given certain statements, assumed to be true, which are called the hy- 
potheses. For example, suppose that P and Q are compound statements. Then if P 
and P + Q are true, then Q must necessarily be true. This follows from the modus 
ponens tautology in the above list of tautologies. We write this rule of inference 
P,P>Q= Q. It is also classically written 


P 
Pe 
Q 


Some examples of rules of inferences follow, all derived from the above list of 
tautologies: 


Modus ponens 
Contrapositive 
Modus tollens 
Transitivity 
Elimination of cases 
“And” usage 


P,P>Q=>Q 
P+Q=>-Q->-P 
P+Q,7Q>-7P 
P+-Q,Q-R=>P-R 
PVQ,7P=>Q 
PAQ>P,Q 
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10.15.1.5 Deductions 


A deduction from hypotheses is a list of statements, each one of which is either one of 
the hypotheses, a tautology, or follows from previous statements in the list by a valid 
rule of inference. It follows that if the hypotheses are true, then the conclusion must 
be true. Suppose for example, that we are given hypotheses ~q > p, q > 71, Tr; it 
is required to deduce the conclusion p. A deduction showing this, with reasons for 
each step is as follows: 


Statement Reason 


l. q->7r Hypothesis 
2. 7 Hypothesis 
3. =7q Modus tollens (1,2) 
4. =q-—>p Hypothesis 
5. p Modus ponens (3,4) 


10.15.1.6 Predicate calculus 


Unlike propositional calculus, which may be considered the skeleton of logical dis- 
course, predicate calculus is the language in which most mathematical reasoning 
takes place. It uses the symbols of propositional calculus, with the exception of the 
propositional variables p, q, ... . Predicate calculus uses the universal quantifier V, 
the existential quantifier 4, predicates P(x),Q(a,y),..., variables x,y,..., and 
assumes a universe U from which the variables are taken. The quantifiers are illus- 
trated in the following table. 











Symbol Read as Usage Interpretation 
There exists an Ja(a > 10) There is an x such that z > 10 
v For all Va(a? +140) Forallz,2?+140 


Predicates are variable statements which may be true or false, depending on the 
values of its variable. In the above table, “x > 10” is a predicate in the one variable 
x as is ““x* +1 4 0.” Without a given universe, we cannot decide if a statement is 
true or false. Thus V(x? + 1 4 0) is true if the universe U is the real numbers, but 
false if U is the complex numbers. A useful rule for manipulating quantifiers is 





adaP(x) <> Aa7P(z2), 
da7P(cx). 





VaP(x) <3 


For example, it is not true that all people are mortal if and only if there is a person 
who is immortal. Here the universe U is the set of people, and P() is the predicate 
“x is mortal.” This works with more than one quantifier. Thus, 








WasyP(x,y) > ArVy7P(a, y). 


For example, if it is not true that every person loves someone, then it follows that 
there is a person who loves no one (and vice versa). 

Fermat’s last theorem, stated in terms of the predicate calculus (U = the positive 
integers), is YnVaVbVcl(n > 2) > (a” +b” 4 c”)| 
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10.15.2 FUZZY LOGIC 


Notation 
e A, B, C fuzzy sets e@ «4 membership function for set A; 
e x element of a set in the range 0 < pa(x) <1 
Concepts 


1. An ordinary set (not a fuzzy set) is a crisp set. 

2. Definitions 
(a) The point x belongs to the set A if and only if w(x) = 1. 
(b) Set equality A = Bifand only if for all w, wa(x) = wp 
(c) Set inclusion A C B if and only if for all x, a(x) < pp(a) 


3. Fuzzy set Operations 
(a) Complement not A() ot ad Ma(x) 
(b) Intersection Hane(@) = min (wa(x), we(x)) 
(c) Union }bAuB(®) = max (w4(x), B(2)) 
4. Classical set theory operations that apply to fuzzy sets 
(a) De Morganslaw (AN B)=AUB 
(AUB)=ANB 
(b) Associativity (AN B)NC=AN(BNC) 
(AUB)UC=AU(BUC) 
(c) Commutativity ANB=BNOA AUB=BUA 
(d) Distributivity AN (BUC) =(ANB)U(ANC) 
AU(BNC) =(AUB)N(AUC) 
5. Hedges 
Hedges are word concepts that can be interpreted as operators modifying fuzzy 
values. For example: 
(a) Very Ha(a) = [we(x)] 
(b) Somewhat a(x) = [we (2)] 


2 
1/2 


6. Fuzzy controllers 
A common approach to creating a fuzzy controller is the sequence of steps: 


(a) Fuzzification Define fuzzy sets and their membership functions. 
Example: P = {Alice, Bob, Charlie}; [ike coo(p) = (0.1, 0.3, 0.3), 
[Mike warm(p) = (0.4, 0.8, 0.9), Licome to party(p) = (0.7, 0.3, 0.6), ... 

(b) Rule evaluation Implement rules such as “If variable is property then 
action.” Example: “If very cool inside then turn on heat,” “If very 
warm inside then turn on A/C,” “If cold outside then it takes several hours 
to heat house,” ... 

(c) Defuzzification Obtain a crisp result from fuzzy analysis. 

Example: “Turn on heat at 5 PM for party tonight.” 
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10.15.3 LINEAR TEMPORAL LOGIC 


Linear Temporal Logic has propositions and operators. It represents infinite se- 
quences of states where each point in time has a unique successor, based on a linear- 
time perspective. 


1. Propositions: “True" (T), “False" (L), ¢, w, 6, ... 
2. Basic (“ordinary") logical operators: 


(a) 7 negation 
(b) V disjunction or “or" 
(c) oF provable: “x F y means y is provable from 2" 


3. Derived logical operators: 


(a) A conjunction or “and”: AW = 7(7dV 7W) 
(b) => implication: o6>Wp=r7dVy 
(Cc) © equivalence: b6v0=(¢> VU) AW= ¢) 


4. Basic Temporal operators: 


(a) © next (or an “X" is used for “NeXt time") 
(b) U until (or a “U" is used) 


5. Derived Temporal operators: 






















































































(a) eventually (or “sometime in the Future"): O~W=TUYW 
(b) always (or “Globally in the future"): y= 707 
(c) FR release (or an “R" is used) RW = -7(7gU 7W) 
(d) © infinitely often 
(e) 9 eventually forever 
Properties 

1. Distributive Laws 3. Absorption Laws 
(a) O(v4) = (Od AO) (a) 01109 = 
(b) O(¢A¥) = (04) V(O4) hy Bode = Vel 
(c) O(eu w) = (O ?) Z@) w) 4. Expansion Laws 
(d) O(@V p) = (09) VOY) (a) GUY = oVOAOC(EUY)) 
(e) O(¢A ) = (Oe) ADY) (b) 06 = 6V(O 04) 
































\ 
(f) OU(dVw) = (0U 4) V(OUY) (c) O¢ = 6A(CO¢) 
(g) (PAY)UG = (6U8) AU) 




















5. Negation propagation 


















































2. Idempotency Laws (a) AO¢=O-7¢ 
(a) 006 = 06 (b) =O¢ = 0nd 
Wipes sere (c) 0¢ = O49 
(c) PU(bUY) = GUY (d) A($U wp) = (APR -=W) 


(d) (@UY)UY= guy (e) -(RV) = (7dU 7) 
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10.16 MOMENTS OF INERTIA 


The moment of inertia is f,, p(r)r{. dV where p(r) is the density and r, is the 
perpendicular distance from the axis of rotation. 


center 
a and b to b ag 
a and b perpendicular to the sheet ra 


(5) | Thin circular sheet of radius r | Normal to the plate through 
ta center 


(6) | Thin circular sheet of radius r | Along any diameter any diameter 

(7) | Thin circular ring, radii r1 Through center normal to 
and ra plane of ring 

(8) | Thin circular ring, radii 71 Along any diameter 
and ro 


Rectangular parallelopiped, Through center 
edges a, b, and c perpendicular to face ab 
parallel to edge c 


(io) | Sphere, radius 

(11) | Spherical shell, external 27 
radius 71, internal radius r2 mes 

i aon aa a bi a 
mean radius r 

(13) | Right circular cylinder of Longitudinal axis of the 
radius 7, length / slide 

(14) | Right circular cylinder of Transverse diameter m (= 4 5) 
radius 7, length / 

(15) | Hollow circular cylinder, Longitudinal axis of the “i rptrs 
radii r; and r2, length / figure 2 

(16) | Thin cylindrical shell, length | Longitudinal axis of the 
1, mean radius r figure 

(17) | Hollow circular cylinder, Transverse diameter m( (4 se a 
radii 71 and rg, length / 

” oe on ces i? 
thin, length 1, mean radius r 

(19) | Elliptic cylinder, length J, Longitudinal axis 
transverse semiaxes a and b 

(20) | Right cone, altitude h, radius | Axis of the figure 
of base r 
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10.17 MUSIC 


Music principles do not depend on a specific key; the key of C' is used in examples. 


Definitions 
1. Map the pitches to numbers from 0 to 11 as follows: 
e0=C e4=E£ ° 8=Gt= 
el=Ch{= e5=F e9=A 
e2=D e6=Ft=G) e 10=AL= 
e 3=Di= e7=G ell=B 


Nn 


. A pitch class set (or peset), shown as {...}, is an unordered set of numbers 


representing notes. For example, the C major chord {C, F, G} is {0, 4, 7}. 


. A pitch class segment (or pcseg), shown as (...), is an ordered set of numbers 


representing notes. For example, the first part of the main theme in Hay- 
din’s Surprise Symphony is (C,C,E,E,G,G,E,F,F,D,D,B,B,G) = 
(0,0,4,4,7,7,4,5,5,2,2,11,11, 7). 


. Define the transposition by n operator T,, by T;,(x) = x +n (mod 12). 


For example, the transposition of a C major pcset by 7 steps is 
T7(C major peset) = T7({C, FE, G}) = T7({0, 4, 7}) 
= {T;(0),T7(4), T7(7)} = {7, 11, 2} = {G, B, D} 
= G major chord 


. Define the inversion about n operator I, by I,(a~) = —x + n (mod 12). 
. Given a specific pcseg, define the collection of transpositions of it to be prime 


forms, define the collection of inversions of it to be inverted forms. Let S' be 
the collection of all prime and inverted forms. 
For example, given the peseg (GC, D) = (7,0,2), S has 24 elements con- 
sisting of the following: 
Prime forms Inverted forms 

To (7,0, 2) = (7,0, 2) Ip (7,0, 2) = (5,0, 10) 

T, (7,0, 2) = (8, 1,3) I, (7,0, 2) = (6,1, 11) 

T2 (7,0, 2) = (9, 2, 4) I (7,0, 2) = (7, 2,0) 


. Given a 3-element pcseg x, define the operators P, L, and F as follows: 


(a) P (parallel) is the form opposite in type to x with the first and third notes 
switched: P((a,b,c)) = Ia+c((a, 0, c)). 
(b) L (leading tone exchange) is the form opposite in type to x with the 
second and third notes switched: L((a, b,c)) = Inze((a, , c)). 
(c) R (relative) is the form opposite in type to x with the first and second 
notes switched: R((a, b,c)) = Ia+n((a, 6, c)). 
For example: 


e P(0,4,7) = (7,3,0) and P (3, 11,8) = (8,0, 3). 
e £(0,4,7) = (11,7, 4) and L (3, 11,8) = (4,8, 11). 
e R(0,4,7) = (4,0,9) and R (3, 11,8) = (1,3, 6). 
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EXAMPLE Starting with the C major chord (0, 4, 7), the set S consists of the following: 


Prime forms Inverted forms 
C = (0,4, 7) (0, 8,5) = f 
Ct = Db = (1,5, 8) (1,9, 6) = ft = gb 
D = (2,6,9) (2,10,7) =g 
Di} = Eb = (3,7, 10) (3,11, 8) = gb =ab 
E = (4,8, 11) (4,0,9) =a 
F = (5,9,0) (5,1, 10) = ab = bb 
F'{ = Gb = (6, 10, 1) (6,2,11) =b 
G = (7,11, 2) (7,3,0) =c 
Gt = Ab = (8,0, 3) (8,4, 1) = cb = db 
A = (9,1, 4) (9,5,2) =d 
At = Bb = (10, 2,5) (10, 6,3) = db = eb 


B= (11, 3,6) (11,7,4) =e 
where major chords have been given a capital letter and minor chords have been given 
a lowercase letter. 
Results 
1. The transposition and inversions operators can be interpreted to apply to the 


set S of forms. In this context, they satisfy the following rules (where “‘o” 
represents composition): 

Tin ® Th = Tinta 

Tm © In = Im+n 

Im © Tn =Im-n 

Tee Ody ST a 


where the indices are interpreted mod 12. The collection of 12 transposition 
operators and 12 inversion operators form a group called the T/I group. 

2. The P, L, and R operators under composition form a group called the PLR 
group. 

3. The T'/I group and the PLR groups are each isomorphic to the dihedral group 
of order 24. 

4. Consider the group of all permutations of S. In this larger group: 


(a) the group T/T is the centralizer* of the PLR group; and 
(b) the group PLR is the centralizer of the T/I group. 


5. The P, L, and R function have musical significance: 


(a) The function P takes a chord and maps it to its parallel minor or major. 
For example P(C major) = c minor and P(c minor) = C major. 

(b) The function L is a leading tone exchange; L(C' major) = e minor. 

(c) The function R takes a chord and maps it to its relative minor or major. 
For example R(C major) = a minor and R(a minor) = C' major. 





?The centralizer of a subgroup H of a group G is the set of elements of G which commute with all 
elements of H. 
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10.18 OPERATIONS RESEARCH 


Operations research integrates mathematical modeling and analysis with engineering 
in an effort to design and control systems. 


10.18.1 LINEAR PROGRAMMING 


Linear programming (LP) is a technique for modeling problems with linear objective 
functions and linear constraints. The standard form for an LP model with n decision 
variables and m resource constraints is 


n 


Minimize Ci XL; objective function), 
guj 4] 
aed 
“;>0 forj=1,---,n, (non-negativity requirement), 
Subject to : : : 
/ Lo ajjt; =b; for? =1,---,m, (constraint functions), 
j=1 


where z, is the amount of decision variable j used, c; is decision 7's per unit contri- 
bution to the objective, a;; is decision 7's per unit usage of resource i, and 0, is the 
total amount of resource 7 to be used. 

Let x represent the (n x 1) vector (x1,--- ,2)', ¢ the (n x 1) vector 
(c1,-*+ ,¢n)', b the (m x 1) vector (b1,--- , bm)", A the (m x n) matrix (aj;), 
and A.; the (n x 1) column of A associated with x;. Then the standard model, in 
matrix notation, is “minimize c'x subject to Ax = b and x > 0.” A vector x is called 
feasible if and only if Ax = b andx > 0. 


10.18.1.1 Modeling in LP 


LP is an appropriate modeling technique if the following four assumptions are satis- 
fied by the situation: 


1. All data coefficients are known with certainty. 

2. There is a single objective. 

3. The problem relationships are linear functions of the decisions. 
4. The decisions can take on continuous values. 


Here are two examples of LP modeling: 


1. Product mix problem — Consider a company with three products to sell. Each 
product requires four operations and the per unit data are given as follows: 


== = a =e 


= 
35 


Hours —- — 
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Let «4,2, and xg represent the number of units of A, B, and C' manufac- 
tured daily. A model to maximize profit subject to the labor restrictions is 
Maximize 45274 + 90x%B + 552¢ (total profit), 
2x4 + 3x%p + 2xc¢ < 480 (drilling hours), 
304 + 6%p + lac < 960 (assembly hours), 
Subject to: lv4+2x%—+4%c < 540 (finishing hours), 











224 +4%¢p + lac < 320 (packing hours), 
tard, @p>0, ro>0. 


2. Maximum flow through a network — _ Consider the directed network 
below. Nodes S' (and 7’) are the source (and terminal) nodes. On each arc 
material up to the arc capacity C;; can be shipped. Material is neither 
created nor destroyed at nodes other than S and T. The goal is to maximize 
the amount of material that can be shipped through the network from 
Sto T. If x;; represents the amount of material shipped from node 7 
to node 7, a model that determines the maximum flow is shown below. 


@ C) 
Maximize 27 +237 + 247, 


ts, = %13+214+2%17 (node | conservation), 





Ugq = 93 + Lo4 (node 2 conservation), 


Subject to 213 + 93 = @37 (node 3 conservation), 





ts4+%24 +214 = Xap (node 4 conservation), 


O< aj; <Cji; forall pairs (i,7) (are capacity). 


10.18.1.2 Transformation to standard form 


Any LP model can be transformed to standard form as follows: 


1. If the problem has “maximize objective,” change it to “minimize objective” 
and multiply every c; by —1 
2. If the problem has “<” constraints, change them to 
n 


66 


constraints by intro- 


ducing non-negative slack variables {S;} to a Aijgt; < Oj. 
j=l 


n 
That is, the new formulation is: S> aig; +S; = 6; with S; > 0. 
j=l 
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3. If the problem has “>” constraints, change them to “=” constraints by intro- 
n 


ducing non-negative surplus variables {U;} to ce ajyjx; > Oj. 


=i 
n 


That is, the new formulation is: Le ajyjx; — U; = bj with U; > 0. 
j=l 


All slack and surplus variables have c; = 0. 


10.18.1.3. Solving LP models: simplex method 


Assume that there is at least one feasible x vector, and that A has rank m. Geo- 
metrically, because all constraints are linear, the set of feasible x forms a convex 
polyhedral set (bounded or unbounded) that must have at least one extreme point. 
The motivation for the simplex method for solving LP models is the following: 


For any LP model with a bounded optimal solution, an optimal solution 
exists at an extreme point of the feasible set. 


Given a feasible solution x, let x? be the components of x with x; > 0 and xX 
be the components with 7; = 0. Associated with x? define B as the columns of A 
associated with each x; in x? For example, if x2, 4, and S; are positive in x, then 
xP = (x2, 24, 5,)', and B is the matrix with columns A.2,A.4, A.s,. Define N as 
the remaining columns of A, i.e., those associated with x. A basic feasible solution 
(BFS) is a feasible solution where the columns of 5 are linearly independent. The 
following theorem relates a BFS with extreme points: 


A feasible solution x is at an extreme point of the feasible region if and 
only if x is a BFS. 


The following simplex method finds an optimal solution to the LP by finding the 
optimal partition of x into x? and x: 


Step (1) Find an initial basic feasible solution. Define x? xB, N,c®,ande% as 
above. 

Step (2) Compute the vector ec’ = (eX — ce? BN). If c; > 0 for all j, then 
stop; the solution x? = B~'b is optimal with objective value c? B~'b. 
Otherwise, select the variable x; in x with the most negative ci value, 
and go to Step (3). 

Step (3) Compute A’; = B~'A.;. If A’, < 0 for all j, then stop; the problem 


is unbounded and the objective can decrease to —oo. Otherwise, compute 
/ 


b’ = B~'b and find min —. Assume the minimum ratio occurs in 
ila‘, >0 aij 

row r. Insert x; into the rth position of x? take the variable that was in 

this position, and move it to the x partition. Update B, N, c®, and c% 

accordingly. Go to Step (2). 
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Ties in the selections in Steps (2) and (3) can be broken arbitrarily. The unbound- 
edness signal suggests that the model is missing constraints or that there has been 
an incorrect data entry or computational error, because, in real problems, a profit or 
cost cannot be unbounded. For maximization problems, only Step (2) changes. The 
solution is optimal when Cj < 0 for all 7, then choose the variable with the maximum 
Cj value to move into x?. Effective methods for updating B~! in each iteration of 
Step (3) exist to ease the computational burden. 

To find an initial basic feasible solution define a variable A; and add this vari- 
able to the left-hand side of constraint 2 transforming to yi aij + Aj = b;. The 
new constraint is equivalent to the original constraint if and only if A; = 0. Also, 
because A; appears only in constraint i and there are m A; variables, the columns 
corresponding to the A; variables are of rank m. We now solve a “new” LP model 
with the adjusted constraints and the new objective “minimize >," , A;.” If the op- 
timal solution to this new model is 0, the solution is a basic feasible solution to the 
original problem and we can use it in step (1). Otherwise, no basic feasible solution 
exists for the original problem. 


10.18.1.4 Solving LP models: interior point method 


An alternative way to determine extreme points is to cut through the middle of the 
polyhedron and go directly towards the optimal solution. Karmarkar’s method as- 
sumes that the LP model has the following form: 


n 
Minimize y CiL5, 


= 1 

So aij; =0 fori = 1, ,m, 

j=l (10.18.1) 
Subject to 7 
j=l 

x; > 0, forj =1,--- ,n. 
Also, assume that the optimal objective value is 0 and that x; = 1/n for 7 = 
1,--- ,n is feasible. Any model can be transformed so that these assumptions hold. 


The following centering transformation, relative to the k'" estimate of solution 
vector x", takes a feasible solution vector x and transforms it to y such that x* is trans- 
afar 
vrai (er /®) , 
represent an n x m matrix with off-diagonal entries equal to 0 and the diagonal entry 

in row 7 equal to af The formal algorithm is as follows: 


formed to the center of the feasible simplex: y; = Let Diag(«*) 


Step (1) Initialize xo = 1/nand set the iteration count k = 0. 


Step (2) If 3 at cj is sufficiently close to 0, then stop; x* is optimal. Otherwise go 
j=l 


to Step (3). 
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Step (3) Move from the center of the transformed space in an improving direction 


using 
yet = E 1 4) _ 61 — P?(PP™)~'P)[Diag(x*)|e" 
nin’ n ICp|]/n(n — 1) 


where ||C;,|| is the length of the vector (I — P? (PP?)~1!P)[Diag(x*)|e7, 
P is an (m+1) x n matrix whose first m rows are A[Diag(x")] and whose 
last row is a vector of 1's, and 6 is a parameter between 0 and 1. 

Step (4) Find the new point x**! in the original space by applying the inverse trans- 
formation of the centering transformation to y**1. Set k = k + 1 and go to 
Step (2). 


The method is guaranteed to converge to the optimal solution when @ = + is used. 


10.18.2 DUALITY AND COMPLEMENTARY SLACKNESS 


Define y; as the dual variable (shadow price) representing the purchase price for a 
unit of resource i. The dual problem to the primal model (maximize objective, all 
constraints of the form “<”’) is 


Minimize » biyi, 
i=l 
is (10.18.2) 


QijYi = Cj forj =1,...,n, 
Subject to d, koe : 


yi = 0, fora 1 Me 
The following results link the dual model (minimization) with its primal model (max- 
imization). 


1. Weak duality theorem: If that x and y are feasible solutions to the respective 


primal and dual problems, then yy city < y, biyi. 
j=l i=1 
2. Strong duality theorem: If the primal model has a finite optimal solution x*, 


then the dual has a finite optimal solution y*, and > Cjz; = ~ biy;. 
j=l i=1 
3. Complementary slackness theorem: If x and y are feasible solutions to the 
respective primal and dual problems. Then, x is optimal for the primal and y 
is optimal for the dual if and only if: 


Yi* b — \ > aiga; = 0, for2 = 1,--- >, and 


m 
«i (Sooun-a) =o forj =1,--- ,n. 
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10.18.3 LINEAR INTEGER PROGRAMMING 


Linear integer programming models result from restricting the decisions in linear 
programming models to be integer valued. The standard form is 


n 
Minimize Ss CjXj (objective function), 
j=l 
te > 0, and integer for 7 = 1,...,n, (10.18.3) 
Subject t ” 
= » Gigi = bi fori =1,...,m (constraint functions). 
j=l 


As long as the variable values are bounded, then the general model can be trans- 
formed into a model where all variable values are restricted to either 0 or 1. Hence, 
algorithms that solve 0-1 integer programming models are usually sufficient. 


10.18.3.1 Branch and bound 


Branch and bound implicitly enumerates all feasible integer solutions to find the 
optimal solution. The main idea is to break the feasible set into subsets (branching) 
and then evaluate the best solution in each subset or determine that the subset cannot 
contain the optimal solution (bounding). When a subset is evaluated, it is said to 
be fathomed. The following algorithm performs the branching by partitioning on 
variables with fractional values and uses a linear programming relaxation to generate 
a bound on the best solution in a subset: 


Step (1) Assume that a feasible integer solution, called the incumbent, is known 
whose objective function value is z (initially, z may be set to infinity if no 
feasible solution is known). Set p, the subset counter equal to 1. Make the 
original model be the first problem in the subset list. 

Step (2) If p = 0, then stop. The incumbent solution is the optimal solution. Other- 
wise go to Step (3). 

Step (3) Solve the LP relaxation of the p" problem in the subset list (allow all integer 
valued variables to take on continuous values). Denote the LP objective 
value by v. If v > z or the LP is infeasible, then set p = p — 1 (fathom 
by bound or infeasibility), and go to Step (2). If the LP solution is integer 
valued, then update the incumbent to the LP solution, set z = min(z, v) 
and p = p— 1, and go to Step (2). Otherwise, go to Step (4). 

Step (4) Take any variable x; with fractional value in the LP solution. Replace prob- 
lem p with two problems created by individually adding the constraints 
x; < |xv;| and z; > [x,;| to problem p. Add these two problems to the 
bottom of the subset list replacing the p problem, set p = p+ 1, and go to 
Step (2). 
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10.18.4 NETWORK FLOW METHODS 


A network consists of N (a set of nodes) and A (a set of arcs). Each are (7, 7) defines 
a connection from node i to node j. Depending on the application, arc (i, 7) may 
have an associated cost and upper and lower capacity on flow. 

Decision problems on networks can often be modeled using linear programming 
models, and these models usually have the property that solutions from the simplex 
method are integer valued (the total unimodularity property). Because of the under- 
lying graphical structure, more efficient algorithms are also available. We present 
the augmenting path algorithm for the maximum flow problem and the Hungarian 
method for the assignment problem. 


10.18.4.1 Maximum flow 


Let x,; represent the flow on arc (i, 7), ci; the flow capacity of (7, 7), S be the source 
node, and T’ be the terminal node. The maximum flow problem is to ship as much 
flow from S' to T’ without violating the capacity on any arc, and all flow sent into a 
node must leave that node (except for S' and T’). The following algorithm solves the 
problem by continually adding flow-carrying paths until no path can be found: 


Step (1) Initialize x;; = 0 for all (2, 7). 

Step (2) Find a flow-augmenting path from S to 7’ using the following labeling 
method. Start by labeling S with a*. From any labeled node 7, label node 
j with the label 2 if 7 is unlabeled and x;; < c¢;; (forward labeling arc). 
From any labeled node 7, label node 7 with the label 2 if 7 is unlabeled 
and x;; > 0 (backward labeling arc). Perform labeling until no additional 
nodes can be labeled. If T’ cannot be labeled, then stop. The current x;; 
values are optimal. Otherwise, go to Step (3). 

Step (3) There is a path from S' to T where flow is increased on the forward labeling 
arcs, decreased on the backward labeling arcs, and gets more flow from S$ 
to T’. Let F’ be the minimum of c;; — x;; over all forward labeling arcs and 
of x; over all backward labeling arcs. Set x;; = x;; + F for the forward 
arcs and x;; = x;,; — F for the backward arcs. Go to Step (2). 


The algorithm terminates with a set of arcs with xj; = cj; and if these are 
deleted, then S' and T are in two disconnected pieces of the network. The algorithm 
finds the maximum flow by finding the minimum capacity set of arcs that disconnects 
S and T (minimum capacity cutset). 


10.18.5 ASSIGNMENT PROBLEM 


Consider a set J of m jobs and a set J of m employees. Each employee can do 1 
job, and each job must be done by 1 employee. If job 7 is assigned to employee 7, 
then the cost to the company is c;;. The problem is to assign employees to jobs to 
minimize the overall cost. 
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This problem can be formulated as an optimization problem on a bipartite graph 
where the jobs are one part and the employees are the other. Let C’ be the m x m 
matrix of costs c;;. The following algorithm solves for the optimal assignment. 


Step (1) Find J; = min c;; for each row 2. Let ¢,; = cj; — i. Find nj = min cj for 
J a 


each column j. Let ¢;; = cj; — nj. 

Step (2) Construct a graph with nodes for S, 7’, and each element of the sets J 
and J. Construct an arc from S to each node in J, and set its capacity to 1. 
Construct an arc from each node in J to T, and set its capacity to 1. If 
cjj = 0, then construct an arc fromi € I to 7 € J, and set its capacity 
to 2. Solve a maximum flow problem on the constructed graph. If m units 
of flow can go through the network, then stop. The maximum flow solution 
on the arcs between I and J represents the optimal assignment. Otherwise, 
go to Step (3). 

Step (3) Update C’ using the following rules based on the labels in the solution to 
the maximum flow problem: Let L; and L; be the set of elements of J and 
J, respectively, with labels when the maximum flow algorithm terminates. 


Let 6 = min cj; note that 6 > 0. Fort € Ly andj € (J — Ly), 
i€L7,je(J—-Ls;) 


set cj; = cj; — 6. Fori € (I— Ly) andj € Ly, set ci; = cj; + 6. Leave 
all other c;; values unchanged. Go to Step (2). 


In Step (3), the algorithm creates new arcs, eliminates some unused arcs, and 
leaves unchanged arcs with x;; = 1. When returning to Step (2), you can solve the 
next maximum flow problem by adding and deleting the appropriate arcs and starting 
with the flows and labels of the preceding execution of the maximum flow algorithm. 


10.18.6 SHORTEST PATH PROBLEM 


Consider a network (V, A) where N is the set of nodes, A the set of arcs, and d;; 
represents the “distance” of traveling on arc (7,7) (if no arc exists between 7 and 
Jj, dij = oo). For any two nodes R and S, the shortest path problem is to find the 
shortest distance route through the network from R to S. Let the state space be N and 
a stage representing travel along one arc. f*(i) is the optimal distance from node i 
to S. The resultant recursive equations are f*(i) = _ ida; + f°, for all ¢.. 


Dijkstra’s algorithm can be used successively to approximate the solution to the 
equations when d;; > 0 for all (2, 7). 


Step (1) Set f*(S) = 0 and f*(i) = djg for alli € N. Let P be the set of 
permanently labeled nodes; P = {S}. Let T = N — P be the set of 
temporarily labeled nodes. 

Step (2) Find: € T with f*(i) = min f°(J)- Set T = T — {i} and P = PU {i}. 


If T = § (the empty set), then stop; f*(R) is the optimal path length. 
Otherwise, go to Step (3). 
Step (3) Set f*(j) = min[f* (7), f*(@) + dij] for all 7 € T. Go to Step (2). 
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10.18.7 HEURISTIC SEARCH TECHNIQUES 


Heuristic search techniques are commonly used for combinatorial optimization prob- 
lems. A method starts with an initial vector xo and attempts to find improved solu- 
tions. Define x to be the current solution vector, f(x) to be its objective value and 
N(x) to be its neighborhood. For the remainder of this section, assume that we seek 
the minimum value of f(x). In each iteration of a neighborhood search algorithm, 
we generate a number of solutions x’ € N(x), and compare f(x) with each f(x’). If 
f(x’) is a better value than f(x), then we update the current solution to x’ (termed 
accepting x' ) and we iterate again searching from x’. The process continues until 
none of the generated neighbors of the current solution yield lower solutions. Com- 
mon improvement procedures such as pairwise interchange and “k-opt,” are specific 
instances of neighborhood search methods. Note that at each iteration, we move to a 
better solution or we terminate with the best solution seen so far. 

The key issues involved in designing a neighborhood search method are the def- 
inition of the neighborhood of x, and the number of neighbors to generate in each 
iteration. When the neighborhood of x is easily computed and evaluated, then one 
can generate the entire neighborhood to ensure finding a better solution if one exists 
in the neighborhood. It is also possible to generate only a portion of the neigh- 
borhood (however, this could lead to premature termination with a poorer solution). 
Generally, deterministic neighborhood search can only guarantee finding a local min- 
imum solution to the optimization problem. One can make multiple runs, each with 
different xo, to increase the chances of finding the global minimum solution. 


10.18.7.1 Simulated annealing (SA) 


Simulated annealing is a neighborhood search method that uses randomization to 
avoid terminating at a locally optimal point. In each iteration of SA, a single neighbor 
x’ of x is generated. If f(x’) < f(x), then x’ is accepted. Otherwise, x’ is accepted 
with a probability that depends upon f(x’) — f(x), and a non-stationary control 
parameter. Define the following: 

1. C; is the k" control parameter 

2. Ly is the maximum number of neighbors evaluated while the k'" control pa- 

rameter is in use 
3. I, is the counter for the number of solutions currently evaluated at the k" 
control parameter 
To initialize the algorithm, assume that we have an initial value xo and sequences 
{C;,} (termed the cooling schedule) and {L;,} such that C;, + 0 as k > oo. The 
SA algorithm to minimize f(x) is: 
Step (1) Setx = x9, k =1 and I, = 0. 
Step (2) Generate a neighbor x’ of x, compute f(x’) and increment J;, by 1. 
Step (3) If f(x’) < f(x), then replace x with x’ and go to Step (5). 
Step (4) If f(x’) > f(x), then with probability ef-f0))/C®, replace x with x’. 
Step (5) If I;, = Lx, then increment k by 1, reset J, = 0 and check for the termina- 
tion criterion. If the termination criterion is met, then stop, x is the solution, 
if not then go to Step (2). 
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The algorithm terminates when C;, approaches 0, or there has been no improvement 
in the solution over a number of C;, values. In the above description only the current 
solution is stored; not the best solution encountered. In practice however, in Step 
(2), we also compare f(x’) with an incumbent solution. If the incumbent solution 
is worse, then we replace the incumbent with x’, otherwise we retain the current in- 
cumbent. Note that SA only generates one neighbor of x in each iteration. However, 
we may not accept x’ and therefore may generate another neighbor of x. 

Several issues must be resolved when implementing SA. If Ci, goes to zero too 
quickly, then the algorithm can easily get stuck in a local minimum solution. If C) is 
large and C;, tends to zero too slowly, then the algorithm requires more computation 
to achieve convergence. Under various technical conditions, there are convergence 
proofs for this method. 


10.18.7.2 Tabu search (TS) 


Tabu search is similar to simulated annealing. A problem in SA is that one can start 
to climb out of a local minimum solution, only to return via a sequence of “better” 
solutions that leads directly back to where the algorithm has already searched. Also, 
the neighborhood structure may permit moving to areas where one knows that no 
optimal solutions exist. Finally, a modeler may have insight on where to look for 
good solutions and SA cannot easily enable searching of specific areas. Tabu search 
tries to remedy each of these deficiencies. 

The key terminology in TS is S(x), the set of moves from x. This is similar 
to the neighborhood of x, and is all the solutions that you can get to from x in one 
move. A “move” is similar to an SA “step,” but is more general because it can 
be applied to both continuous and discrete variable problems. Let s be a move in 
S(x). For example, consider a 5-city traveling salesman problem where x is a vector 
containing the sequence of cities visited, including the return to the initial city. Let 
x = (2,1,5,3,4,2). If we define a move to be an “adjacent pairwise interchange,” 
then the set of moves S(x) is: 

{{(1, 2,5, 3, 4, 1), (2,5, 1,3, 4, 2), (2,1, 3,5, 4, 2), (2, 1,5, 4,3, 2), (4,1,5,3,2,4)} 


As another example, if we use a standard non-linear programming direction—step 
size search algorithm, then one can construct a family of moves of the form $'(x) = 
x-+ ud. Here, wu is a step size scalar and d is the direction of movement and the family 
depends on the values of u and d selected. 

To run a Tabu search, define 7’ as the tabu set; these are a set of moves that 
the method should not use. Define OPT to be the function that selects a particular 
s € S(x) that creates an eventual improvement in the objective. Then 
Step (1) Start with initial incumbent xp. Set x = x9, k =0,T = @. 

Step (2) If S(x) — T = 4, then go to Step (4). Otherwise set k = k + 1 and select 
sp © S(x) — T such that s,(x) = OPT(s | s € S(x)—T). 

Step (3) Let x = s;,(x). If f(x) < f(xo), then xp = x. 

Step (4) If a chosen number of iterations has elapsed either in total or since xp was 
last improved, or if S(x) — T = ¢ from Step (2), then stop. Otherwise, 
update 7’ (if necessary) and go to Step (2). 
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The method is more effective if the user understands the solution space and can guide 
the search somewhat. Often the tabu list contains solutions that were previously 
visited or solutions that would reverse properties of good solutions. Early in the 
method, it is important that the search space is evaluated in a coarse manner so 
that one does not skip an area where the optimal solution is located. Tabu search 
can move to inferior solutions temporarily when OPT returns a solution that has a 
worse objective value than f(x) and, in fact, this happens every time when x is a 
local minimum solution. 


10.18.7.3 Genetic algorithms 


A different approach to heuristically solving difficult combinatorial optimization 
problems mimics evolutionary theory within an algorithmic process. A population of 
individuals is represented by K various feasible solutions x; fork = 1,..., A. The 
collection of such solutions at any iteration of a genetic algorithm is referred to as a 
generation, and the individual elements of each solution x; are called chromosomes. 
For instance, in the context of the traveling salesman problem, a generation would 
consist of a set of traveling salesman tours, and the chromosomes of an individual 
solution would represent cities. 

To continue drawing parallels with the evolutionary process, each iteration of a 
genetic algorithm creates a new generation by computing new solutions based on the 
previous population. More specifically, an individual of the new generation is created 
from parent solutions by a crossover operator. The crossover operator describes 
how a solution is created by combining characteristics of the parent solutions. The 
selection of the crossover operator is a key aspect of designing an algorithm. 

The rules for composing a new generation differ among implementations, but 
often consist of selecting some of the best solutions from the previous generation 
along with some new solutions created by crossovers from the previous generation. 
Additionally, these solutions may mutate from generation to generation in order to 
introduce new elements and chromosomal patterns into the population. The objec- 
tive value of each new solution in the new generation is computed, and the best 
solution found thus far in the algorithm is updated if applicable. The creation of the 
new generation of solutions concludes a genetic algorithm iteration. The algorithm 
stops once some termination criteria is reached (e.g., after a specified number of 
generations are evolved, or perhaps if no new best solution was recorded in the last 
q generations). A typical genetic algorithm for minimization is: 


Step (1) Choose a population size kK’, a maximum number of generations Q, and a 
number of survivors S < K, where K, Q, and S are integers. Also, choose 
a mutation probability p (typically, p is small, perhaps close to 0.05). Create 
an initial set of solutions x,, for k = 1,..., A, and define Generation 0 
to be these solutions. Calculate the objective function of each solution in 
Generation 0, and let x* with objective function f(x*) denote the best such 
solution. Initialize the generation counter 7 = 0. 

Step (2) Copy the best (according to objective function value) S solutions from Gen- 
eration 7 into Generation 7 + 1. 


780 CHAPTER 10. MISCELLANEOUS 


Step (3) Create the remaining kK — S solutions for Generation 7 + 1 by executing a 
crossover operation on randomly selected parents from Generation 7. For 
each new solution x; created, calculate its objective function value f (x;). 
If f(x) < f(x*), then set x* = x, and f(x*) = f (xx). 

Step (4) For k = 1,..., A, mutate solution x; in Generation 7 with probability p. 
Calculate the new objective function value f(x;,), and if f(x,) < f(x*), 
then set x* = x; and f(x*) = f (xx). 

Step (5) Seta =i+ 1. If2 = Q, then terminate with solution x*. Otherwise, go to 
Step 2. 


Three specific process concerns are addressed below. 


1. The initial population — Careful consideration should be given to the creation 
of the initial set of solutions for Generation 0. For instance, a rudimentary 
constructive heuristic may be used to create a set of good initial solutions rather 
than using some blindly random approach. However, it is important that the set 
of heuristic solutions is sufficiently diverse. That is, if all initial solutions are 
nearly identical, then the solutions created in the next generation may closely 
resemble those of the previous generation — limiting the scope of the genetic 
algorithm search space. Hence, one may penalize solutions having too close a 
resemblance to previously generated solutions in the initial step. 

2. The crossover process — The crossover operator is the most important con- 
sideration in a genetic algorithm. While the selection of the parents for the 
crossover operation is done randomly, preference should be given to parent 
solutions having better quality objective function values (imitating mating of 
the most fit individuals, as in evolution theory). However, feasibility restric- 
tions on the structure of a solution must be recognized and addressed. 


EXAMPLE For example, in the traveling salesman problem, a feasibility restric- 
tion is that each solution be a permutation of integers. Consider the following 
two parent solutions, where a return to the first city is implied: 


(1,3,5,2,4,6) and (1,2,3,6,5,4). 


A crossover operator that takes the first (last) three chromosomes from the first 
(second) parent would result in the solution (1, 3, 5, 6, 5, 4), which is not a per- 
mutation and cannot be used. A better operator would start with the preceding 
operator and post-process the result by replacing repeated chromosomes with 
omitted chromosomes. In the above example, city 5 is repeated while city 2 is 
omitted, and thus one of the following two solutions would be generated: 


(1,3,2,6,5,4) or (1,3,5,6,2,4). 


3. The mutation operator — A genetic algorithm without a mutation operator 
may have the solutions within the same generation converge to a small set of 
distinct solutions, from which radically different (and perhaps optimal) solu- 
tions cannot be created via the crossover operator. The purpose of the mutation 
operator is to inject diverse elements into future iterations. The mutation op- 
erator must generate significant enough change in the solution to ensure that 
there exists a chance of having this modification propagate into solutions in 
future generations. 
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10.19 PROOF METHODS 


1. 


10. 


Combinatorial Proof Prove that P and Q represent the same thing 
e Show that P and Q are counting some item, but in different ways. 
e Example: Show that >; (7) = 2”. 


. Direct Proof Prove PP => Q 


e Assume that P is true. 
e Use the fact that P is true to show that Q must be true. 
e Example: The sum of 2 adjacent integers is odd. 


. Geometric Proof Prove a geometric relationship 


e Assemble needed definitions, axioms, postulates 

e Combine the assembly, using logical deductions, to reach the goal 

e Example: An angle and the lengths of the two adjacent sides characterize 
a triangle. 


. Nonconstructive Proof Prove P is true. 


e Create an example, for which all the specifics are not known, which 
forces P to be true. 
e Example: Show there are irrational numbers a and b with a? is rational. 


. Proof by Cases/Proof by Exhaustion Prove P(s) is true foralls € S 


e Methodically show, for each s € S, that P(s) is true. 
e Example: Every positive integer less than 10 has a square less than 100. 


. Proof by Construction There exists an entity having a property P 


e Explicitly construct such an entity. 
e Example: There is a prime large than 100. 


. Proof by Contradiction Prove P is false 


e Assume that P is true. 

e Use the fact that P is true to show via logic that something is true, when 
we know that thing to be false. 

e Example: /2 is a rational number. 


. Proof by Contrapositive Prove PP =>Q 


e Logically, the proposition P => Q is equivalent -Q => -P. 
e Instead of proving P => Q, prove the equivalent statement. 
e Example: If x? is even, then x is even. 


. Proof by Induction 


Prove an indexed proposition, P(n), is true forn = 1,2,... 
e Show that P(1) is true. 
e Show that P(m) => P(m+1) form >1 
e Example: If a and b are consecutive integers, then a + b is odd. 


Visual Proof — see page 3 
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10.20 RECREATIONAL MATHEMATICS 


10.20.1 MAGIC SQUARES 


A magic square is a square array of integers with the property that the sum of the 
integers in each row or column is the same. If (c,n) = (d,n) = (e,n) = (f,n) 
(cf — en,n) = 1, then the array A = (a;;) will be magic (and use the n? numbers 
k =0,1,...,n? — if aj; =k with 








t=ck+e = | (mod n) and jz=dk+f H (mod n) 





For example, with c = 1,d =e = f = 2, and n = 3, a magic square is| 2 | 3 | 7 |. 








}4 [810 
An antimagic square is one for which the sums of each row, column, and main 
diagonal are different and are also sequential integers. Examples include: 
[21 | 18] 6 [17] 4 | 


ste) sys pops ps] 


HEEB SIT} fapeps pepo] 
10.20.2 POLYOMINOES 


Consider the two-dimensional connected shapes formed from NV unit squares. Allow 
them to move in space (e.g., they can be flipped over). 

1. For N = 1 there is only the single monomino. 

2. For N = 2 there is only the single domino. 

3. For N = 3 there are two distinct trominoes. 

4. For N = 4 there are five distinct tetrominoes. They are used in the game tetris. 


5. For N = 5 there are 12 distinct pentominoes (where the customary name for 


each shape is shown below). 
[. uF T 
ads 


6. For N = 6,7,8, A ie mu are ee 108, a ae ... unique polyominoes. 
The number of three-dimensional polyominoes with N cubes (for V = 1,2,...) is 
1,1, 2,8, 29, 166, 1023, 6922, 48311, 346543, 2522522, 18598427, 138462649,.... 
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10.21 RISK ANALYSIS AND DECISION RULES 


Decision rules are actions that are taken based on the state {0), 02,... } of asystem. 
For example, in making a decision about a trip, the states may be rain and no rain and 
the decision rules are stay home, go with an umbrella, and go without an umbrella. 

A loss function is a function that depends on a specific state and a decision rule. 
For example, consider the following loss function (0, a): 


Loss function data 


Possible actions System state 
0; (rain) 65 (no rain) 


Stay home ay 
Go without an umbrella ag 
Go with an umbrella a3 





It is possible to determine the “best” decision even without obtaining any data. 


1. Minimax principle 
With this principle one prepares for the worst. For each action it is possible 
to determine the minimum possible loss that may be incurred. This loss is 
assigned to each action; the action with the smallest (or minimum) maximum 
loss is the action chosen. 
For the given loss function data the maximum loss is 4 for action a1 and 5 for 
action a2 or a3. Under a minimax principle, the chosen action would be a1 
and the minimax loss would be 4. 

2. Minimax principle for mixed actions 
Assume that action a; is taken with probability p; (with p; + po + p3 = 1). 
Then the expected loss L(6;) is given by L(0;) = p,0(6;, a1) + p2l(0;, a2) + 
p3(0;, 43). The above data results in the following expected losses: 


Beal — ee i: + P2 aI Ps A (10.21.1) 


The minimax point of this mixed action case satisfies L(0,) = L(02). Using 
this and p; + p2 + p3 = 1 results in L(0,) = L(02) = 4 — 7p3/5. Hence, ps3 
should be as large as possible; or p = (2, 3, 3). 
Hence, if action az is chosen 3/8’s of the time, and action az is chosen 5/8’s 
of the time, then the minimax loss is equal to L = 25/8. This is a smaller loss 
than using a pure strategy of only choosing a single action. 
3. Bayes actions 
If the probability distribution of the states {91, 02,...} has the density function 
g(6;) then the loss has an expectation of B(a) = >, g(6:)€(0;, a); this is the 
Bayes loss for action a. A Bayes action is an action with minimal Bayes loss. 
For example, assume that g(0,) = 0.4 and g(@2) = 0.6. Then B(a,) = 4, 
B(az) = 2, and B(a3) = 3.8 which leads to the choice of action az. 
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A course of action can also be based on data about the states of interest. For example, 
a weather report Z will give data for the predictions of rain and no rain. Continuing 
the example, assume that the correctness of these predictions is given as follows: 


eS CACO ACD 


Predict rain zy 0.8 0.1 
Predict no rain 29 0.2 0.9 





That is, when it will rain, then the prediction is correct 80% of the time. 
A decision function is an assignment of data to actions. For this example there 
are 37 = 9 possible decision functions, {d1, d2,..., dg}; they are: 


Decision functions 


Predict z}, take action | a, a2 a3 a, d2 a, a3 a2 a3 
Predict z2, take action | a, a2 a3 d2 a, a3 a, a3 a2 


The risk function R(@,d;) is the expected value of the loss when a specific decision 
function is being used. This results in the following values: 


Risk function evaluation 
Di (rain) 2 (ho rain 


4 4 
5 0 
2 5 

42 0.4 

4.8 3.6 

3.6 49 

2.4 41 

4.4 45 

2.6 0.5 








This array can now be treated as though it gave the loss function in a no—data prob- 
lem. The minimax principle for mixed action results in the “best” solution being rule 
dg for it’s of the time and rule dg for <2’ of the time. This leads to a minimax loss 
of 22. Before the data Z is received, the minimax loss was 2. Hence, the data 7 is 
“worth” = - _ = ae in using the minimax approach. 

The regret function r(6, a) is the loss, (8, a), minus the minimum loss for that 0: 
r(0,a) = €(0,a) — miny (6,6). This is the contribution to loss that even a good 
decision cannot avoid. Hence r(0, a) is a loss that could have been avoided had the 
state been known—hence the term “regret.” For the given loss function data, the 


minimum loss for 9 = 6; is 2, for 6 = @2 it is 0. In this case the regret function is 


| | 61 (rain) 2 (no rain) 


ay 2 4 
a2 3 0 
a3 0 5 


If the minimax principle is used to determine the “best” action, then, in this example, 
the “best” action is a2. 
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10.22 SIGNAL PROCESSING 


10.22.1 ESTIMATION 
2 


Let {ez} be a white noise process (white noise satisfies E[e;] = ju, Var [er] = 07, 
and Cov [ez,es] = 0 for s 4 t). Suppose that {X;} is a time series (sequence of 
values in time). A non-anticipating linear model presumes that en hy Xisy = Gs 
where the {h,,} are constants. This can be written H(z)X; = e; where H(z) = 
bea hyz” and z”X; = X;_n. Alternately, X; = H~1(z)e;. In practice, several 
types of models are used: 


1. AR(k), autoregressive model of order k: This assumes that 
A(z) =1+ajz+---+ag2,~ and so 


Xt + ay X41 Sees arXt_k = €t- (10.22.1) 


2. MA(l), moving average of order /: This assumes that 
A-\(z) =1+b,z+-:-+b,z, and so 


Xt = é€tr byez_4 eds bjet_1- (10.22.2) 





3. ARMA(k,/), mixed autoregressive/moving average of order (k,1): This as- 


sumes that H~!(z) = tse and so 


X_+ayXy¢_1+...anX¢_K = €¢ + Ope¢_-1 +++ + Op ee_ 1. (10.22.3) 


10.22.2 WINDOWING 


A signal {x(n)} can be truncated by multiplying by a windowing sequence: 
Lw(n) = x(n) w(n) where 


vio) = 2 n=0,1,...,N-—1 


0 otherwise 


and f(n) < 1. Windowing functions are often symmetric to avoid changing the 
linear phase of the signal. 


Window Expression First sidelobe 


Rectangular | w/( —13.46 dB 


; 27n 
Hamming Vo ) 


Hanning 
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10.22.3 MATCHED FILTERING 


Let X(t) represent a signal to be recovered, let N’(t) represent noise, and let Y(t) = 
X(t) + N(t) represent the observable signal. A prediction of the signal is 


Xp) =f K@Y(-2)ae, (10.22.4) 
0 


where A(z) is a filter. The mean square error is E [(X (t) — X;(¢))?]; this is mini- 
mized by the optimal (Wiener) filter Ko(z). 

When X and ¥Y are stationary, define their autocorrelation functions as Rx x (t— 
s) = E[X(t)X(s)] and Ryy(t — s) = E[Y(t)Y(s)]. If F represents the Fourier 
transform, then the optimal filter is given by 





: 1 F[Rxx(t)] 
F [Kop (t)] = — =. 10.22.5 
[Kop (¢)] In F [Ryy (t)] ( ) 
For example, if X and N are uncorrelated, then 
: 1 F ([Rxx(t)| 
F |Kop (t)| = — —-— SS. 10.22.6) 
Kon (8) = 95 FRx] + F enn) 
In the case of no noise, F [Kop:(t)] = s¢. Kop:(t) = 6(t), and S(t) = Y(t). 


10.22.4 COSTAS ARRAYS 


Ann Xn Costas array is an array of zeros and ones whose two-dimensional autocor- 
relation function is n at the origin and no more than | anywhere else. There are By, 
basic Costas arrays; there are C;, arrays when rotations and flips are allowed. Each 
array can be interpreted as a permutation. 


In [123 4 


By, 555-990 
Cr, |]1 2 4 12 40 116 200 444 760 2160 4368 7852 
n 


in | B 4 15 16 +47 18 19 20 
B, | 1616 2168 2467 2648 2294 1892 1283 810 
Cr, | 12828 17252 19612 21104 18276 15096 10240 6464 
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10.22.5 KALMAN FILTERS 


Kalman filtering is a linear least squares recursive estimator. It is used when the 
state space has a higher dimension than the observation space. For example, in some 
airport radars the distance to aircraft is measured and the velocity of each aircraft is 
inferred. 


Nn WN re 


. X is the unknown state to be estimated 

. X is the estimate of x 

. Zis an observation 

. {w, v} are noise terms 

. {Q, R} are spectral density matrices 

. “a ~ N(b,C)” means that the random variable a has a normal distribution 


with a mean of b and a covariance matrix of C’ 


. “Extended Kalman filter”: State propagation is achieved through sequential 


linearizations of the system model and the measurement model 


. “(—)” is the value before a new discrete observation and “(++)” is the value 


after a new discrete observation 


10.22.5.1 Discrete Kalman filter 


1. 
2. 
3. 


Oo ONAN fF 


System model Xj, = Op_1Xp—1 + Wh-1 wy, ~ N(0, Qx) 
Measurement model z, = Hy,x;, + Vx; vz ~ N(0, Ry) 
Initial conditions E [x(0)] = Xo, 
E [(x(0) — Xo) (x(0) — X0)"] = Po 
. Other assumptions E [wavy | = 0 forall 7 andk 
. State estimate extrapolation Xx (—) = ®p_1Xp-1(+) 


. Error covariance extrapolation P,(—) = ®,—1Pr—1(+)®f_, + Qr-1 
. State estimate update ;,(+) = X,(—) + Kx[z~ — HeXx(—)] 
. Error covariance update P;(+) = [J — Ky,H;,] Pr(—) 


. Kalman gain matrix Ky, = Pi(—) Hp [Hi.Pe(—) Hp + Rx] = 





10.22.5.2 Continuous Kalman filter 


1. System model x(t) = F'(t)x(t)+G(t)w(t); w(t) ~ N(0, Q(t)) 
2. Measurement model z(t) = H(t)x(t) + v(t); v(t) ~ N(0, R(t)) 
3. Initial conditions x(0) =Xo, P(0)=Py, 
E [x(0)] =X, EB [(x(0) — Xo)(x(0) — Xo)"] = Po 

4. Other assumptions R-l(t) exists, E[w(t)v'(r)] = C(t)d(t — 7) 
5. State estimate propagation x(t) = F(t)x(t) + K(t) (z(t) — H(t)x(t)] 
6. Error covariance propagation 

P(t) = F(t)P(t) + P(t)F™(#) + G(t)Q(t)GT (t) — K(#)R(t)K1(t) 
7. Kalman gain matrix K(t) = [P(t)H"(t) + G(t)C(t)] R-1(t) 
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10.22.5.3 Continuous extended Kalman filter 


1. System model x(t) = f(x(t), t) + w(t); w(t) ~ N(0, Q(t)) 

2. Measurement model z(t) = h(x(t)) + v(t); v(t) ~ N(0, R(t)) 

3. Initial conditions x(0) ~ N (Xo, Po) 

4. Other assumptions E [w(t)v"(r)] =0 for all ¢ and all 

5. State estimate propagation x(t) = f(X(t), t) + K(t) [z(t) — h(&(t), t)] 
6. Error covariance propagation 


n~ 


P(t) = F(R(t),2)PO) + P()F" (R(2), t) + Q(t) 





7. Gain equation K(@) = PHA &),HR-*@) 
” > Of(x(t), t) 
8. Definitions F(x(t),t) = 
a ; x(t)=X(t) 
H(x(t),t) = mae 
GOD Ox(t) |x) =2(0) 





10.22.5.4 Continuous-discrete extended Kalman filter 


1. System model x(t) = f(x(t), t) + w(t); w(t) ~ N(0, Q(t)) 
2. Measurement model = zy, = hy, (x(tx)) + Va; vi ~ N(0, Ry) 
k =1,2,... 
3. Initial conditions x(0) ~ N(Xo, Po) 
4. Other assumptions E [w(t)v;,] = 0 for all k and all t 
5. State estimate propagation x(t) = f(x(t), t) 
6. Error covariance propagation 


P(t) = F(&(t), t)P(t) + POF" (x(t), t) + Q(t) 
7. State estimate update X;,(+) = Xx (—) + Kx [ze — he (Xx (—))] 
8. Error covariance update P;,(+) = [I — Ky Hx (Xp(—))| Pe(—) 
9. Gain matrix 
Ky = Px(—) Hg (®e(—)) [Hie (®e(—)) Pe (—) AG (®e(—)) + Re] 





1 





10. Definitions FQR(),0) = Of(x(t), t) 
nae x(t)=X(t) 
~ ( hh; X(tk 
Ay (Xk (—)) = 
Ox(te) — Ix(ty)=Re(-) 





10.22.6 WAVELETS 
+0o 


Constructing wavelet orthonormal bases {7,,,} Tacs begins by choosing real co- 
efficients ho,...,h» satisfying the following (set hy = Oifk < Oork > n): 


. Normalization: )>,, hy = J/2. 

. Orthogonality: \>,, hy hy—2j3 = 1 if j = O and Oif 7 A 0. 

. Accuracy p: ¥>,,(—1)*k/ hy, = 0 for j = 0,...,p — 1 with p > 0. 

. Cohen—Lawton criterion: A technical condition rarely violated by coefficients 
which satisfy the normalization, orthogonality, and accuracy p conditions. 


BRWN Re 
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These four conditions imply the existence of a solution » € L?(R), called the scaling 
function, to the following refinement equation: 


= V2S> hx p(20 — k). (10.22.7) 


The scaling function is normalized so that [ y(a)daz = 1. Then y(x) is unique, 

and it vanishes outside of the interval [0,n]. The maximum possible accuracy is 
= (n+ 1)/2. 

For each fixed integer j, let V; be the closed subspace of L7(IR) spanned by 

the functions {y;,n}{2° ., where yj,n(x) = 2//2—y(2/a2 — k). The projection of 

f(x) onto the subspace V; is an approximation at resolution af a. It is given by 


fj (2) = Tp Ce ja (@) with Cy, = (f, 05,6) = J f(x) pin (x 
The wavelet w is derived from the scaling function y by - aa 


=V25S~ g.p(2e—k), where gx = (-1)* Rn—a- (10.22.8) 
k=0 


The wavelet 7 has the same smoothness as y, and the accuracy p condition implies 
vanishing moments for ~: { 2/a(x) dx = 0 for j = 0,...,p— 1. The functions 
W;,n(@) = 24/2)(2%x — k) are orthonormal and the entire collection {7); ,} (where 
j > Oand 0 < k < 2%) forms an orthonormal basis for the Hilbert space L?(R). 
That is, functions f with finite energy, i.e., ape | f(x) |? da < co. 


10.22.6.1 Haar wavelets 


The Haar wavelet H(a) and its corresponding scaling function are 


Haj=<{-1 dps o<1 (10.22.9) 


0 otherwise 


: 1 
ee ie ga) {1 #OSe<1 
eC) = 
0 otherwise 


Define the Haar system {H;} by Hj,(a) = 2%/?H (2a — k). While the Haar 
wavelet is the simplest possible, it is not continuous and therefore not differentiable. 


Ho ,0(«) Ho,1(«) 
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10.22.6.2 Daubechies wavelets 


For each even integer N > 0, there is a unique set of coefficients ho,...,hn—1 
which satisfy the normalization and orthogonality conditions with maximal accuracy 
p = N/2. The corresponding y and w are the Daubechies scaling function Dx and 
Daubechies wavelet Wy. The Haar wavelet H is the Daubechies wavelet W2. For 
the Haar wavelet, the coefficients are hy = hy = 1/ ,/2 and the subspace V; consists 
of all functions which are piecewise constant on each interval [k2~/, (k + 1)2~). 


D4 WwW, 








De . We 














va 


10.22.7_ THE CONTINUOUS WAVELET TRANSFORM 


The continuous wavelet transform of a function f(t) with respect to a mother 
wavelet w is defined as 








Wolfllad) =f fle VFaole) ae, (10.22.10) 
where a 4 0 and b are real numbers and 
1 z—b 
Wa,b(x) = sa" ( 7 ). (10.22.11) 


The parameters a and 0 are called the scale (frequency) and translation parameters, 
respectively. 
The mother wavelet is assumed to satisfy the condition 


omen 2 
Cy = an f CO ia < oO, (10.22.12) 


-co |u| 


where wb = F(w) is the Fourier transform of «. Condition (10.22.12) is the admissi- 
bility condition. 
The constant 1/,/|a| in (10.22.11) is a normalizing constant introduced so that 


Iveol? =f baola)Pde =f” WG) de = IP. 
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If w is integrable, i.e., oo (x)| dx < oo, then the admissibility condition is sat- 
isfied only if 


Example: A commonly used mother wavelet is 
the Mexican Hat function; it is the second deriva- 
tive of a Gaussian. When normalized so that 


[PI]? = 1, itis p(x) = 


(0) =0 or a w(x)dx = 0. (10.22.13) 


(l-22)e-*' 2, : 





7/4/83 





Properties of The Continuous Wavelet Transform 


1. 


2: 


4. 


5: 


Another Version of the Wavelet Transform: Since 
F (a(a))(w) = V/la] ec’ (aw), (10.22.14) 


another version of the continuous wavelet transform in terms of the Fourier 
transform of the wavelet is 


Wal f](a, b) = v/Jal _ * Flw)e®"G (aw) deo. (10.22.15) 


Linearity: |The continuous wavelet transform is a continuous linear trans- 
formation, i.e., 


Wylaf(x) + Bg(x)] = aWy[f(e)] + BWelg@)I, 


where a and 3 are complex numbers. This maps L?(R) into the Hilbert space 


L? (R?,a~? dadb) = (F(ab): [. [iF (0,0)? SP <0), 


with inner product 





(F, G) 12(R2,,) = (F,G) a fF G(a, b) dui(a, b) 
where dyi(a, b) = dadb/a?. 
. Translation: 
Wolf (a + l(a, 6) = Wolf (a)](a,6 + 0) (10.22.16) 
Dilation: 
x a b 
Wy ly (=)] @ b) = Ve Wy LF (2)] (* *). c>0. (10.22.17) 
Interchanging of Mother Wavelets: If @ and w are admissible mother 


wavelets, then 


Wyldl(a, b) = Wold (=. -2) | (10.22.18) 


a a 
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6. Inversion formula: The inversion formula of the wavelet transform given 


by (10.22.10) is 


f(x) == af i. Wolf ](a, b)bao(x — (10.22.19) 


where Cy, is given by (10.22.12). 
The inversion formula for the wavelet transform given by (10.22.15) is 


1 


= —____ oa [f](a, be”? db. (10.22.20) 
2m Tal Fon | , 


. Parseval’s relation: Let f,g € L?(R) and denote their continuous wavelet 


transforms with respect to the same mother wavelet by F' and G, respectively. 
In view of (10.22.15) and (10.22.20), we obtain 


(Wo[f], Wolo] r2(R2,n) = (FG) 12 (R2,n) = Cul h; 9) 12(R) = Cu(f, 9) 12(R); 


(10.22.21) 

where C'y is given by (10.22.12). In particular, 
|Fllz2ce2y) = Cullfllzz@- (10.22.22) 
If w is normalized so that Cy, = 1, it follows that the continuous wavelet 


transform is an isometry from L?(R) into L?(R?, 11). 


. A Generalized Parseval’s Relation: For the two mother wavelets w and ¢ 


define a 
Cy,o = an f a dw < oo, (10.22.23) 


and denote the continuous wavelet transform of f,g € L?(R) with respect to 
w and ¢ by W,[f] and W4[g], respectively. Then 


(WaLF], Wolg]) 2202, = Cv,o(F,9) = Cu,o(f,9) (10.22.24) 
If W = ¢, Formula (10.22.24) reduces to (10.22.21). 


. A Generalized Inversion Formula: The following inversion formula is a 


consequence of (10.22.24). It shows that if the continuous wavelet transform is 
taken with respect to a mother wavelet y, the inversion formula may be taken 
with respect to a different mother wavelet ¢. In fact, the following relation 
holds 








d ae 
f(a) = 5— a |. [. Wel fl(a,0)}a0(e)— anes (10.22.25) 
wo 
In particular if @ = w, we obtain 
f(x) = af. [. Wolf ](a, b)bao(x yao (10.22.26) 
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10.22.8 THE DISCRETE WAVELET TRANSFORM AND 
WAVELET SERIES 


The discrete wavelet transform of f may be viewed as the values of the continuous 
wavelet transform of f taken at a lattice of points obtained by discretizing the pa- 
rameters a and b. The standard choices are: a = aj’ with a9 > 0 and ap ¥ 1, 
b = nboag’ with bo # 0, and m and n are integers (0, +1,+2,...). We choose, 
without loss of generality, @ > 1 and bo > 0. 

The discrete wavelet transform of f, also called the wavelet coefficients of f, is 


defined as the doubly indexed sequence 














Fann) = Wolfllon.n) = (Feebmn) = fh ” SOD iloie, 


where m2 
Um n(&) = ag /~w(ag'e — nbo). (10.22.27) 
We call the series >, f(m, 2) mn (2) the wavelet series of f, the func- 


tion x(x) the mother wavelet, and the functions {1m ,(x)} the wavelets. 

Thus, wavelets are functions generated from one single function (the mother 
wavelet) by dilation (scaling) and translation. The standard choice for a and b are 
a = 2 and b = 1, and in this case the wavelets are called dyadic wavelets. 


10.22.9 WALSH FUNCTIONS 


The Rademacher functions are defined by r;,(z) = sgn sin (2***ma). If the binary 
expansion of n has the form n = 2"! + 2’ +.---+ 2’, then the Walsh function 
of order n is W,,(”) = rj, (@)ri, (a)... 1%,, (a). The Rademacher functions are an 
orthogonal system but they are not complete. 


———SS eee | 
-———== ss —— 
TS oO} 





a ———— a a 
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10.23 UNITS 


10.23.1 


SI SYSTEM OF MEASUREMENT 


SI, the abbreviation of the French words “Systéme Internationale d’ Unités,” 


is the 


accepted abbreviation for the International Metric System. 


1. There are 7 base units 


Quantity measured Soe 


Length 
Mass 


Time 


Amount of substance 
Electric current 
Luminous intensity 


meter 
kilogram 
second 
mole 
ampere 
candela 


Thermodynamic temperature | kelvin 





2. There are 22 derived units with special names and symbols. 
When a unit is named after a person, the unit’s name is in lower case letters 
and the unit’s symbol starts with a capital letter. 


Quantity 


Absorbed dose 
Activity (radiation source) 
Capacitance 
Catalytic activity 
Celsius temperature 
Conductance 

Dose equivalent 
Electric charge 
Electric potential 
Electric resistance 
Energy 

Force 

Frequency 
Tlluminance 
Inductance 
Luminous flux 
Magnetic flux density 
Magnetic flux 

Plane angle (unitless) 
Power 

Pressure or stress 
Solid angle (unitless) 





SI Name Combination of 
other SI units 


(or base units) 


Symbol 


gray 
becquerel 
farad 
katal 
Celsius 
siemen 
sievert 
coulomb 
volt 
ohm 
joule 
newton 
hertz 

lux 
henry 
lumen 
tesla 
weber 
radian 
watt 
pascal 
steradian 
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3. The following units are accepted for use with SI units. 


Symbol | Value in SI units 


(angle) degree 
(angle) minute 
(angle) second 
(time) day 

(time) hour 
(time) minute 
astronomical unit 
bel 


electronvolt 

liter 

metric ton 

neper 

unified atomic mass unit 


angstrom 
are 

barn 

bar 

curie 
hectare 
knot 
nautical mile 
rad 

rem 
roentgen 





i 1° = (7/180) rad 
1! = (1/60)° = (7 /10800) rad 
1” = (1/60)! = (1 /648000) rad 
1d=24h = 86400 s 
1 h=60 min = 3600 s 
1 min=60s 
lau 1.49598 x 10!! m 


1B=(1/2)In 10 Np 

(Note that 1 dB = 0.1 B) 

leV & 1.6021764 x 10-'°C 
1L=1dm?=107? m? 
1t=10%kg 

1 Np = | (unitless) 

lus 1.66054 x 107?’ kg 


1A= 0.1 nm = 10-1 m 

la=1 dam? = 10? m? 

1b=100 fm? = 10778 m? 

1 bar = 0.1 MPa = 100 kPa = 1000 hPa = 10° Pa 
1 Ci = 3.7 x 101° Bq 

lha= 1 hm? = 104 m? 

1 nautical mile per hour = (1852/3600) m/s 
1 nautical mile = 1852 m 

1 rad = 1 cGy = 10~? Gy 

l rem = 1 cSv = 107? Sv 

1R = 2.58 x 10-4 Chkg 


10.23.2 TEMPERATURE CONVERSION 


If ty is the temperature in degrees Fahrenheit and tc is the temperature in degrees 


Celsius, then 


tc = 2 is — 32) 


9 


and tp = atc 4.9. (10.23.1) 





—40°C | O°C } 10°C | 20°C | 387°C | 100°C 
—AO0°F | 32°F | 50°F | 68°F | 98.6°F | 212°F 


If Tx is the temperature in kelvin and T’p is the temperature in degrees Rankine, then 


Tr = tr + 459.69 


and 


5 
Tk = te + 273.15 = 5Tp. (10.23.2) 
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10.23.3. UNITED STATES CUSTOMARY SYSTEM OF WEIGHTS 
AND MEASURES 


1. Linear measure 
1 mile = 5280 feet or 320 rods 
1 rod = 16.5 feet or 5.5 yards 
1 yard = 3 feet 
1 foot = 12 inches 
2. Linear measure: Nautical 
1 fathom = 6 feet 
1° of latitude = 69 miles 
1° of longitude at 40° latitude = 46 nautical miles 53 miles 
1 nautical mile = 6076.1 feet + 1.1508 statute miles 
3. Square measure 
1 square mile = 640 acres 
1 acre = 43,560 square feet 
4, Volume measure 
1 cubic yard = 27 cubic feet 
1 cubic foot = 1728 cubic inches 


5. Dry measure 
1 bushel = 4 pecks 


1 peck = 8 quarts 
1 quart = 2 pints 


6. Liquid measure 
1 cubic foot = 7.4805 gallons 


1 gallon = 4 quarts 
1 quart = 2 pints 
1 pint = 4 gills 
7. Liquid measure: Apothecaries’ 
1 pint = 16 fluid ounces 
1 fluid ounce = 8 drams 
1 fluid dram = 60 minims 
8. Weight: Apothecaries’ 
1 pound = 12 ounces 
1 ounce = 8 drams 
1 dram = 3 scruples 
1 scruple = 20 grains 
9. Weight: Avoirdupois 
1 ton = 2000 pounds 
1 pound = 16 ounces or 7000 grains 
1 ounce = 16 drams or 437.5 grains 


10. Weight: Tro 
- 1 pound = 12 ounces 


1 ounce = 20 pennyweights 
1 pennyweight = 24 grains 
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10.23.4 UNITS OF PHYSICAL QUANTITIES 


The units of a system’s parameters constrain all the derivable quantities, regardless 
of the equations describing the system. In particular, all derived quantities are func- 
tions of dimensionless combinations of parameters. The number of dimensionless 
parameters and their forms are given by the Buckingham pi theorem. 

Suppose u = f(Wi,...,W,) is to be determined in terms of n measurable 
variables and parameters {W;} where f is an unknown function. Let {u,W;} in- 
volve m fundamental dimensions labeled by Ly,..., Ly, (e.g., length or mass). The 
dimensions of the {u,W;} are given by a product of powers of the fundamental 
dimensions. For example, the dimensions of W; are Lei ... [im where the 
{b;;} are real and called the dimensional exponents. A quantity is called dimension- 


less if all of its dimensional exponents are zero. Let b; = [bit Ata dim] be the 
dimension vector of W; and let B = [bi a b,, be the m x n dimension ma- 


trix of the system. Let a = [ax se elk be the dimension vector of w and let 
1 : 
y= [vi ces Yn| represent a solution of By = —a. Then, 


1. The number of dimensionless quantities is k + 1 = m+ 1 — rank(B). 
2. The quantity u can be expressed in terms of dimensionless parameters as 


= Wy We oo WY orig a, «- 2 TR) (10.23.3) 
where {7z;} are dimensionless quantities. Specifically, let x = 
[z1 at Zni| be one of k = n — r(B) linearly independent solutions 


of the system Bx = 0 and define 7; = W/W? --- Wr. 


In the following, it may be easier to think “kilograms” for the mass /, “meters” for 
the length L, “seconds” for the time 7’, and “degrees” for the temperature 6. For 
example, acceleration is measured in units of L/T?, or meters per second squared. 


Quantity Quantity 


Acceleration Momentum ML/T 
Angular acceleration Period T 
Angular frequency Power ML? /T? 
Angular momentum J Pressure 

Angular velocity Moment of inertia 

Area Time 

Displacement Torque 

Energy MIP iT? Velocity 

Force ML/T? Volume 

Frequency 1/T Wavelength 

Gravitational field strength | ML/T? Work Mile yr? 
Gravitational potential MiAlT? Entropy ML? /T70 
Length L Internal energy ML?/T? 
Mass M Heat Mi? /T? 
Mass density M/L3 
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EXAMPLES 


1. Shock wave propagation from a point explosion 


Suppose a nuclear explosion, represented as a point explosion of energy E, creates a 
shock wave propagating into air of density ». After time t and we want to know the 
radius r. Using the ordering [M i Ff | the physical quantities have dimensions: 

e u=r has dimensions LZ or a = [0 1 o]* 

e W, =t has dimensions T or by = [0 0 1]" 

e W2 = p has dimensions ML~? orbs = [1 —3 o]" 

e W3 = E has dimensions ML?T~? or b3 = [1 2 aop 
so thatn = 3and B = [bi be bs] = [e -3 3]. The rank of B is 3, so there is 


n + 1 —rank(B) = 1 dimensionless quantity. The unique solution of By = —a is 
y= [-2 + —4| - Putting this together, the solution can be represented as 

= = ay = 2\1/5 
u=r=W, "WL ?W, g(m) = aad 8 EMI8 g(r) oR = o (2) 





tearlier 


. . . . tater 
where C’ is a constant. Note, in particular, the scaling law rater = Tearlier ( Later ) 


2. A simple pendulum 


A pendulum swinging under the force of gravity g consists of a (massless) rod of length 
£ and a mass m at the tip. We want to find the oscillation period T,. Using the ordering 


[M L fa the physical quantities have dimensions: 


e u= Ty, has dimensions T or a = [0 0 il” 


e Wi = £has dimensions L or bi = [0 1 0] . 
e W. = mhas dimensions M or bz = [1 0 o]" 
e W3 = g has dimensions LT~? or bs = {9 al = 


if) 
so thatn = 3 and B = [bi bo bs| = [xo 1]. The rank of B is 3, so there is 


n + 1 —rank(B) = 1 dimensionless quantity. The unique solution of By = —a is 
y= [-$ 0 4] es Putting this together, the solution can be represented as 
u = Tp = W, Wy We h(a) = 0/2 m2 g7 1/2 h(a) or Tp = cyt where C 
is a constant. Note, in particular, the period does not depend on the mass m. 
For small oscillations a physics analysis shows that C = 27. 
Drag in a fluid 
A sphere of size £, which is subject to gravity g, is in a fluid with viscosity j1, density p, 
and velocity v. We will determine the drag D. Using the ordering [M L T| : 

e u=Dhas dimensions MLT~? ora = [1 1 =o)" 

e W, = ¢has dimensions L or by = [0 1 o]" 

e W2 = w has dimensions ML7~'T~! orbs = [1 —1 =a)* 

e W3 = p¢ has dimensions ML~? or b3 = [1 —3 o}" 

e W. = v has dimensions LT~* or ba = [0 1 -1]" 

e Ws = g has dimensions LT~? or bs = [0 1 —-2 = 
A solution of By = —aisy = [ D> 0) 1 2 0|'. The null solutions are: 
B[-1 0 0 2 -1]"=0 and Bi -1 1 1 O]'=0. 
Hence, u = D = pl?v? f (Re, Fr) where Re= pv/ yi is the Reynold’s number, 
Fr= v/\/@q is the Froude number, and f (-,-) is a dimensionless function. 
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10.23.5 CONVERSION: METRIC TO ENGLISH 


centimeters 0.3937008 | inches 
cubic meters 1.307951 cubic yards 
cubic meters 35.31467 cubic feet 
grams 0.03527396 | ounces 
kilograms 2.204623 pounds 
kilometers 0.6213712 | miles 


liters 0.2641721 | gallons (US) 
meters 1.093613 yards 

meters 3.280840 feet 
milliliters 0.03381402 | fluid ounces 
milliliters 0.06102374 | cubic inches 
square centimeters | 0.1550003 | square inches 
square meters 1.195990 square yards 
square meters 10.76391 square feet 





10.23.6 CONVERSION: ENGLISH TO METRIC 


cubic feet 0.02831685 | cubic meters 
cubic inches | 16.38706 milliliters 
cubic yards 0.7645549 | cubic meters 
feet 0.3048000 | meters 

fluid ounces | 29.57353 milliliters 
gallons (US) | 3.785412 liters 

inches 2.540000 centimeters 
miles 1.609344 kilometers 
mils 25.4 micrometers 
ounces 28.34952 grams 
pounds 0.4535924 | kilograms 
square feet 0.09290304 | square meters 
square inches | 6.451600 square centimeters 
square yards | 0.8361274 | square meters 
yards 0.9144000 | meters 
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10.23.7 MISCELLANEOUS CONVERSIONS 


feet of water at 4°C 2.950 x 10~? atmospheres 

inches of mercury at 4°C | 3.342 x 107? atmospheres 
pounds per square inch 6.804 x 107? atmospheres 
foot-pounds L285 i0-* BTU 

joules 9.480 x 10-4 BTU 

cords 128 cubic feet 

radian 57.29578 degree (angle) 
foot-pounds 1.356 x 10" ergs 

atmospheres 33.90 feet of water at 4°C 
miles 5280 feet 

horsepower 3.3% 10° foot-pounds per minute 
horsepower-hours 1.98 x 10° foot-pounds 
kilowatt-hours 2:655.< 10° foot-pounds 
foot-pounds per second | 1.818 x 1073 horsepower 
atmospheres 29.92 inches of mercury at 0°C 
BTU 1.055060 x 10° | joules 

foot-pounds 1.35582 joules 

BTU per minute 1.758 x 107? kilowatts 
foot-pounds per minute | 2.26 x 107° kilowatts 
horsepower 0.7457 kilowatts 

miles per hour 0.8689762 knots 

feet 1.893939 x 10~4 | miles 

miles 0.8689762 nautical miles 
degrees 1.745329 x 10~? | radians 

acres 43560 square feet 

BTU per minute 17.5796 watts 





10.23.8 PHYSICAL CONSTANTS 
c (speed of light) = 299,792,458 m/s (exact value) 
e (charge of electron) + 1.6021764 x 10719 C 
i (Plank constant over 277) © 1.0545716 x 10734 Js 
Acceleration, sea level, latitude 45° ~ 9.806194 m/s? = 32.1726 ft/s? 
Avogadro’s number ~ 6.022142 x 107% 
Density of mercury, at 0°C % 13.5951 g/mL 
Density of water (maximum), at 3.98°C & 0.99997496 g/mL 
Density of water, at O°C + 0.9998426 g/mL 
9. Density of dry air, at 0°C, 760 mm of Hg % 1.2927 g/L 
10. Heat of fusion of water, at O°C + 333.6 J/g 
11. Heat of vaporization of water, at 100°C *% 2256.8 J/g 
12. Mass of hydrogen atom © 1.67353 x 10774 g 
13. Velocity of sound, dry air, at 0°C + 331.36 m/s © 1087.1 ft/s 


CAN, RO 
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10.24 VOTING POWER 


A weighted voting game is represented by the vector [g; wi, w2,-.-, Wn]: 


There are n players. 

Player 2 has w,; votes (with w; > 0). 

A coalition is a subset of players. 

A coalition S is winning if Pies Ww; = q, where q is the quota. 
A game is proper if 4) wi <q. 


a 


A player 


1. Can have veto power: no coalition can win without this player 
2. Can be a dictator: has more votes than the quota 
3. Can be a dummy: cannot affect any coalitions 


10.24.1  SHAPLEY-SHUBIK POWER INDEX 


Consider all permutations of players. Scan each permutation from beginning to end 
adding together the votes that each player contributes. Eventually a total of at least q 
will be arrived at, this occurs at the pivotal player. The Shapley—Shubik power index 
(@) of player 2 is the number of permutations for which player 7 is pivotal; divided 
by the total number of permutations. 
EXAMPLE 
1. Consider the [5; 4, 2,1, 1] game, the players are {A,B,C,D}. 
2. For the 4! = 24 permutations of four players the pivotal player is underlined: 
ABCD BACD CABD DABC 
ABDC BADC CADB DACB 
ACBD BCAD CBAD DBAC 
ACDB BCDA CBDA DBCA 
ADBC BDAC CDAB DCAB 
ADCB BDCA CDBA DCBA 
3. Hence player A has power ¢(A) = _ = 0.75. 
4. The other three players have equal power of = = 0.083. 


10.24.2 BANZHAF POWER INDEX 


Consider all 2% possible coalitions of players. For each coalition, if player i can 
change the winning-ness of the coalition, by either entering it or leaving it, then 7 is 
marginal or swing. The Banzhaf power index (3) of player 7 is proportional to the 
number of times he is marginal; the total power of all players is 1. 


802 


CHAPTER 10. MISCELLANEOUS 


EXAMPLE 


1. Consider the [5; 4, 2,1, 1] game, the players are {A,B,C,D}. 


2. There are 16 subsets of four players; each player is “in” (1) or is “out” (Q) of a coalition. 


For each coalition the marginal players are listed 


0000 => {ff} I000 => {B,C,D} 
o00I = {A} I00I = {AD} 
oo0IO0 = {A} I0IO = {AC} 
OOII = {A} IOII = {A} 
orl00 = {A} II00 => {AB} 
OIOI = {A} IIO0I = {A} 
OIIO = {A} IIIo = {A} 
OIII = {A} IIII = {A} 


3. Player A is marginal 14 times, and has power 6(A) = #4 = 0.7 
4. The players B, C, and D are each marginal 2 times and have equal power of = =0.1. 


10.24.2.1 Voting power examples 
1. For the game [51; 49, 48, 3] the winning coalitions are: {1, 2,3}, {1,2}, {1,3} 


and {2,3}. These are the same winning coalitions as the game [3; 1, 1, 1]. 
Hence, all players have equal power even though the number of votes each 
player has is different. 


. The original EEC (1958) had France, Germany, Italy, Belgium, The Nether- 


lands, and Luxembourg. They voted as [12; 4, 4, 4, 2, 2, 1]. Therefore: 
1 
p= 60 (14 14, 14,9, 9,0) and B= 9] (8 5: 5: 3; 3; 0). (10.24.1) 


. The UN security council has 15 members. The five permanent members have 


veto power. For a motion to pass, it must be supported by at least 9 mem- 
bers of the council and it must not be vetoed. A game representation is: 
1395-75-15. %5 fyty Ly Ly 1,4, 4, 111,41). 

—_—sS:_—an—n—- | owe 


5 members 10 members 
. : _ 421 2, 
(a) Shapley—Shubik powers: of each permanent member @major = 3745 ~ 
0.196, of each minor member @minor = oe ~ 0.002. 
(b) Banzhaf powers: Bmajor = Se x 0.167 and Bminor = aS x 0.017. 


. Changing the quota in a game may change the powers of the players: 


(a) For the game [6; 4, 3, 2] have ¢ = 4(4,1, 1). 
(b) For the game [7; 4, 3, 2] have d = 5(1,1,0). 
(c) For the game [8; 4, 3, 2] have ¢ = 5(1,1, 1). 


. For the n-player game [g;a,1,1,1,1,...,1] wih 1 <a<q<nandn< 


2q + 1— a the powers are dmajor = a/n and dminor = (n — a)/n(n — 1). 


. Four-person committee, one member is chair. Use majority rule until dead- 


lock, then chair decides. This is a [3; 2,1, 1, 1] game so that 6 = 2(3, Tdet): 


. Five-person committee, with two co-chairs. Need a majority, and at least one 


co-chair. This is a [7; 3, 3, 2,2, 2] game so that ¢ = 5 (3, 3, 2, 2,2) and 
B = 39(7,7,5,5,5) 
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10.25 GREEK ALPHABET 


Greek Greek English Greek Greek English 
Alpha 
Beta 
Gamma 
Delta 
Epsilon 
Zeta 
Eta 
Theta 
Tota 
Kappa 
Lambda 
Mu 


Xi 
Omicron 
Pi 

Rho 
Sigma 


Tau 
Upsilon 
Phi 
Chi 


een ane 
Sau ORNMYPHOMS 
ER<eReeeCAQAvrAoMme 





0 1 2 3 4 

e@-e ee eee eee eee 
eee e- ee e e-e 
ee ee- ee: ee ee: 

5 6 7 8 9 

ee eee eee ee e e 
e e ee eee eee ee 
ee ee ee: ee ee 





10.27 MORSE CODE 


Period 
Comma 


Question 
1 


ZPASTHtOAMOAw > 
NK Mad CHMROVOZ 


2 
3 
4 
5 
6 
7 
8 
9 
0 
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10.28 BAR CODES 
All the codes shown here used “123456789” as the input. 
1. Aztec 6. Databar-14 Stack 11. Micro QR code 


ol Tai UCT [a] A 


7. Grid Matrix 


2. Code One 12. PDF 417 


ny Be sey I 


13. Postnet 
. 8. ISBN 
| | | fadlabdathalihdhallitiadihtlmdht 














































































































3. Code 11 14. QR 
9780123 " 456786 
ION oe 
9. KIX Code reer ™ 
ris = 
4. Code 39 Hele AEE ra et 
nests 10. Maxicode 
: 15. UPC-A 
5. Code 1 








01234 

















56789 


















































0 5 





























28 


123456789 

















Chapter 1 
1. 


Chapter 2 


1. 


2. 


3. 


List of References 


Numbers and Elementary Mathematics 


G. H. Hardy, E. M. Wright, A. Wiles, R. Heath-Brown, J. Silverman, An 
Introduction to the Theory of Numbers, Oxford University Press, USA, 
2008. 


. L. B. W. Jolley, Summation of Series, Dover Publications, New York, 


1961. 


. S.G. Krantz, The Elements of Advanced Mathematics, CRC Press, Boca 


Raton, FL, 1995. 


. R. J. Mathar, The series limit of >, 1/[k log k(log log k)?], ArXiv e- 


prints, http: //arxiv.org/abs/0902.0789, accessed 11 December 
2016. 


. R. B. Nelsen, Proofs Without Words: Exercises in Visual Thinking, The 


Mathematical Association of America, Washington D.C., 1997. 


. R. B. Nelsen, Proofs Without Words II: More Exercises in Visual Think- 


ing, The Mathematical Association of America, Washington D.C., 2001. 


. P. Ribenboim, The book of prime number records, Springer-Verlag, New 


York, 1988. 


. L. D. Servi, “Nested Square Roots of 2,’ American Mathematical 


Monthly, volume 110, number 4, April 2003. 


. N.J. A. Sloane and S. Plouffe, Encyclopedia of Integer Sequences, Aca- 


demic Press, New York, 1995. 
Algebra 


D. S. Bernstein, Matrix Mathematics: Theory, Facts, and Formulas with 
Application to Linear Systems Theory, Princeton University Press, 2005. 
I. N. Herstein, Topics in Algebra, 2nd edition, John Wiley & Sons, New 
York, 1975. 

G. Strang, Introduction to Linear Algebra, Third Edition, Wellesley 
Cambridge Press, Wellesley, MA, 2003. 


805 


806 LIST OF REFERENCES 


Chapter 3 Discrete Mathematics 


1. B. Bollobas, Graph Theory, Springer-Verlag, Berlin, 1979. 

2. C. J. Colbourn and J. H. Dinitz, Handbook of Combinatorial Designs, 
CRC Press, Boca Raton, FL, 1996. 

3. J. Gross, Handbook of Graph Theory & Applications, CRC Press, Boca 
Raton, FL, 1999. 

4. K. H. Rosen, Handbook of Discrete and Combinatorial Mathematics, 
CRC Press, Boca Raton, FL, 2000. 

5. R. P. Stanley, Enumerative Combinatorics, Volumes | & 2, Cambridge 
University Press, New York, 1997 & 2001. 


Chapter4 Geometry 


1. A. Gray, Modern Differential Geometry of Curves and Surfaces, CRC 
Press, Boca Raton, FL, 1993. 

2. J. O’Rourke and J. E. Goodman, Handbook of Discrete and Computa- 
tional Geometry, CRC Press, Boca Raton, FL, 1997. 

3. D. J. Struik, Lectures in Classical Differential Geometry, 2nd edition, 
Dover, New York, 1988. 


Chapter5 Analysis 


1. J. W. Brown and R. V. Churchill, Complex Variables and Applications, 
6th edition, McGraw-Hill, New York, 1996. 

2. A. G. Butkovskiy, Green’s Functions and Transfer Functions Handbook, 
Halstead Press, John Wiley & Sons, New York, 1982. 

3. G. F Carrier, M. Krook, and C. E. Pearson, Functions of a Complex 
Variable: Theory and Technique, McGraw-Hill, 1966. 

4. I. S. Gradshteyn and M. Ryzhik, Tables of Integrals, Series, and Prod- 
ucts, D. Zwillinger (ed), 8th edition, Academic Press, Orlando, FL, 2014. 

5. A. J. Jerri, Introduction to Integral Equations with Applications, Marcel 
Dekker, New York, 1985. 

6. S. G. Krantz, Real Analysis and Foundations, CRC Press, Boca Raton, 
FL, 1991. 

7. P. Moon and D. E. Spencer, Field Theory Handbook, Springer-Verlag, 
Berlin, 1961. 

8. A. D. Polyanin and V. F. Zaitsev, Handbook of Exact Solution for Ordi- 
nary Differential Equations, CRC Press, Boca Raton, FL, 1995. 

9. J. L. Synge and A. Schild, Tensor Calculus, University of Toronto Press, 
Toronto, 1949. 

10. D. Zwillinger, Handbook of Differential Equations, 3rd edition, Aca- 
demic Press, Orlando, FL, 1997. 
. D. Zwillinger, Handbook of Integration, Jones & Bartlett, Boston, 1992. 


ee 
a 


LIST OF REFERENCES 807 


Chapter 6 = Special Functions 


1. Staff of the Bateman Manuscript Project, A. Erdélyi, Editor, Tables of 
Integral Transforms, in 3 volumes, McGraw-Hill, New York, 1954. 

2. W. Magnus, F. Oberhettinger, and R. P. Soni, Formulas and Theorems for 
the Special Functions of Mathematical Physics, Springer-Verlag, New 
York, 1966. 

3. N. M. Temme, Special Functions: An Introduction to the Classical 
Functions of Mathematical Physics, Wiley-Interscience, Indianapolis, 
IN, 1996. 

4. N.I. A. Vilenkin, Special Functions and the Theory of Group Represen- 
tations, American Mathematical Society, Providence, RI, 1968. 


Chapter 7 = Probability and Statistics 


1. W. Feller, An Introduction to Probability Theory and Its Applications, 
Volume 1, John Wiley & Sons, New York, 1968. 

2. S. K. Park and K. W. Miller, “Random number generators: good ones are 
hard to find?’ Communications of the ACM, October 1988, 31, 10, pages 
1192-1201. 

3. D. Zwillinger and S. Kokoska, Standard Probability and Statistics Tables 
and Formulae, Chapman & Hall/CRC, Boca Raton, FL, 2000. 

4. MIL-STD-1916, Department of Defense Test Method Standard — “DoD 
Preferred Methods For Acceptance of Product”, 1 April 1996, 
http: //www.sqconline.com/sites/sqconline.com/files/ 
MIL-STD-1916. pdf, accessed | Jan 2017. 


Chapter 8 = Scientific Computing 


1. R. L. Burden and J. D. Faires, Numerical Analysis, 9th edition, Brooks 
Cole, Florence, KY, 2010. 

2. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed., The 
Johns Hopkins University Press, Baltimore, 1996. 

3. J. Marin, “Computing Columns, Footings and Gates through Moments 
of Area,’ Computers & Structures, Vol. 18, No. 2, Feb 1984, pages 343-— 
349. 

4. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Nu- 
merical Recipes: The Art of Scientific Computing, 3rd edition, Cam- 
bridge University Press, New York, 2007. 


Chapter9 = Mathematical Formulas from the Sciences 


1. A. D. Polyanin and A. I. Chernoutsan, A Concise Handbook of Mathe- 
matics, Physics, and Engineering Sciences, Chapman & Hall/CRC, Boca 
Raton, FL, 2011. 

2. “Greeks (finance)”, Wikipedia, the Free Encyclopedia, https: //en. 
wikipedia. org/wiki/Greeks_(finance), accessed 1 March 2017. 


808 


LIST OF REFERENCES 


Chapter 10 Miscellaneous 


1 


2. 


. I. Daubechies, Ten Lectures on Wavelets, SIAM Press, Philadelphia, 

1992. 

D. E. Knuth, “Two Notes on Notation”, ArXiv e-prints, http: //arxiv. 

org/abs/math/9205211, accessed 11 December 2016. 

. FE Glover, “Tabu Search: A Tutorial,’ Interfaces, 20(4), pages 74-94, 
1990. 

. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Ma- 
chine Learning, Addison—Wesley, Reading, MA, 1989. 

. J. P. Lambert, “Voting Games, Power Indices, and Presidential Elec- 
tions,” The UMAP Journal, Module 690, 9, No. 3, pages 214-267, 1988. 

. C. Livingston, Knot Theory, The Mathematical Association of America, 
Washington, D.C., 1993. 

. D. Luce and H. Raiffa. Games and Decision Theory, Wiley, New York, 
1957. 

. FE. J. MacWilliams and N. J. A. Sloane, The Theory of Error-Correcting 
Codes, North-Holland, Amsterdam, 1977. 

. A. O’Maley, “Elliptic Curves and Elliptic Curve Cryptography,” 
B. S. Undergraduate Mathematics Exchange, Vol. 3, No. 1, pages 16- 
24, Fall 2005. 

. G. Strang and T. Nguyen, Wavelets and Filter Banks, Wellesley- 
Cambridge Press, Wellesley, MA, 1995. 

. E. W. Weisstein, CRC Concise Encyclopedia of Mathematics, 2nd edi- 
tion, Chapman & Hall/CRC, Boca Raton, FL, 2002. 

. S. Wolfram, A New Kind of Science, Wolfram Media, IL, 2002. 


List of Figures 


Depiction of right-hand rule... 2... ee ee 


HaSSe:GideTaMs) a: aces, 8 ale lee Po eae hale a OG oh ae a 
Three graphs that are isomorphic. . 2... 2... 0. ee 
Examples of graphs with 6 or 7 vertices. . 2... 2. 2 ee 


Change of coordinates by arotation, . 2... 2... 2. 
Cartesian coordinates: the 4 quadrants .. 2... 2.2. ..0.0.00000000000. 
Polar coordinates? 2 5 s.5.6 5: cas aoa oe ee ek Oe ee RR tee ae he se 
Homogeneous coordinates .. 1... 2. ee 
Oblique:coordinates’ ob. 4:5 2. dw Goa Gn a eae ee ae hE HS aw La 
A shear with factor r= 5.0 6 1 ee 
A perspective transformation... 2... 2 ee 
The: normal fortmof aline: o35,. 404, elds. Bie Re ie Bee hs SO a BS 
Simple polySOns: cs Fee ca Slay oad, GTS le do Re age Bie de EG A ee oe 
Notation foratriangle . 2... 2. ee ee 
Triangles: isosceles andright... 2... 2. 
Ceva’s theorem and Menelaus’s theorem .. 2... 2.2 .200000000000. 
Quadrilateralsts, ardor aca. Beate he Ghee wh he hee, Soo HS, aes vt Gee teeta: a Ee ee ave 
The five non-degenerate conics .. 2... 
Sphericalicaps' 2 as. a eh ela a ede eRe qe eS REG SS 
Right spherical triangle and diagram for Napier’s rule ............... 
DECHONS OFA COME soggy be iow ae Ol a Ge Eee ee oe ae, Bleed ea 
Definition of conics by means of ratios . 2... ee 
Ellipse with major semiaxis a and minor semiaxis b. Here b/a =0.6. ...... 
Hyperbola with transverse semiaxis a and conjugate semiaxis b. Here b/a = 0.4. . 
ATCORACIICIE. 6.6. oman ree dies & sociigs.d) oy Srkae te & eR Hee Pak OS heh ee 
Angles: within'a cirele «a3 8 hae SR Geta Rs es RR Ge HG Ge a 
The general cubic parabola for a > 0. For a < 0, reflect in a horizontal line. 

The semi-cubic parabola, the cissoid of Diocles, and the witch of Agnesi. ..... 
The folium of Descartes in two positions, and the strophoid. ............ 
CASSIUS OVENS: ch a5 ody ne ce: Bae obey Se ee Ga tes ee es et et, eh 
The conchoid of Nichomedes.... 2... ....2.-2.2..2.00000000000. 
Thewlimaconmof Pascal) *.. 340: 3.6.4.9: 4 s: b.a5e wee Rm wR Be He Ke RO aS Be 
Cyclord and trochoids~ 32% 6. a4; 23 bo ot ea ee Ke RE ERED 
Epicycloids: nephroid and cardioid .. 2... 2... ee ee 
The hypocycloids with a = 3b (deltoid) and a = 46 (astroid). .. 2... 2... 
Spirals: Bernoulli, Archimedes, and Cornu... ............00-0005 
Point in Cartesian coordinates... 2... 2... 2... ee 


810 


LIST OF FIGURES 
Cylindncal:cOordin ates: 5.463053. ade Ge Bee We. aye Bad Se howl a Ra ke oe 250 
Spherical coordmates: 4.8 3.5; . 35g as, Glee. Ge Be atlas A he Ghee ee Se 251 
Relations between Cartesian, cylindrical, and spherical coordinatesx ........ 252 
ulerangles:. 4. 2 ko ashy Bite bad Sard ot od ack oe a AN 254 
The: Platonicssolids: 24. sec6)8 Se decat See dead Bag dawn ee de ae we MO oe 263 
Cylinders: oblique and right circular... ee 265 
Right circular cone and frustum . 2... 2. 2 2 ee 266 
Types of:critical pommts: 4... 4. sha: Gade ae we ee oe Bw AK os 362 
The four quadrants and notation for trigonometric functions ............ 425 
Definitions:of-angles: 2.5) ar4. a be Bei den A wick we Me OE OE EY 426 
Sine and cosine, angles are inradians. . 2... 2... ee 426 
Tangent and cotangent, angles are inradians.§ . 2... 2... 2. eee ee 427 
Different triangles requiring solution, ..........0.0.000000.0000. 435 
Graphs of T(m) and 1/T(@) s6 oc ee ae ek ee he Sa ROG Rew E Be 467 
The sine and cosine integrals Si(w) and Ci(z) . 2... ee ee 479 
ISpendre PUNCHOMS 3 shes. as Serco: ecb re We Be ok ak ate Eee a a Bp dk 485 
The Airy functions Ai(z) and Bi(z) 2... ee. 491 
Approximation to binomial distributions .. 2... ...0.0.0.000.0000000. 553 
Conceptual layout of aqueue. .. 2... 2. ee 562 
Area under a normal distribution .. 2.2... 2 2 ee 628 
Illustration of o and 20 regions of a normal distribution. .. 2... ....0.002. 629 
Illustration of Newton’s method .........0.0.020202020 000000000. 649 
Formulae for integration rules with various weight functions ............ 671 
Illustration of the Monte-Carlo method... 2... 2... 2 2 ee 677 
JUSS 4 ouch bh A ee ade ha A AoA ge AE Awd dg 741 
The Mandlébrotvseti:. 4.0. 4a: Ba. Sb Be: de & hse ceed he ects Be yh Ss tahoe 741 
Different elliptic:curves:;.-i.3-.6. 6 6 35% gS e & RS Bek BR ok ee Ge 743 


Addition of points on anelliptic curve .. 2... 0.2... eee ee ee 744 


List of Notations 


Symbols 8 





If ial 16 CXCIUSIVE OF 2.00.00 cceeceeeesvnene 569 
7 actoria! is Nae ge ea URA ERE abi pleats factored graph ........0.0.0.0e00 155 
double factorial ta avedeuedoinsisay ec tapbda setae § 16 fractal arithmetic “plus” ............ 25 
" derivative, first ......... 00... c eee eae 2T7 graph edge suin 159 
" derivative, second .............000205- 277 ‘Kicnecker sate reco Mee 103 
0 max plus algebra 5 slus” eke sts 26 
(S, X) poset notation ............. 138 O , . Pe Sea 
(a)n shifted factorial ete ane eee ad fractal arithmetic “division” ........ 20 
(r, 8, w) type of tensor ............ 379 @ 
(v, k, A) design nomenclature ..... i fractal arithmetic “times” ........... 25 
(x,y, z) point in space ....... ee 249 Kronecker product ................ 104 
(a : y : t) homogeneous coordinates max plus algebra “times” ........... 2% 
ee ae sei , tensor differentiation ..................380 
(a: y: z: t) homogeneous ae ; tensor differentiation .................. 380 
. Poe ce Nosaleph null 0.3 vcesdeenceeeadeaswedion ex 
G sy A) Clebsch—Gordan V universal quantifier ................... 763 
» = A forward difference ................0.. 670 
COCMICIENE a sess Soe 458 
O empty set! cis sevcctavecavasstecwsees 135 
oe bi binomial coefficient .......... 142 J existential quantifier .................. 763 
( a multinomial coefficient h Plank constant over 27 ...........0.0. 800 
ma 143 OOUMMNILY, 4c swiss ideals daceradesamudonedes 9 
ea i Reg Sh Se — logical not 761 
~~ Jacobi symbol ................ 28 eee 
Us O partial differentiation ................. LTT 
(3) Legendre symbol ............. 28 CH dual code toC ...... ccc e cece eee 731 
(#v) fourth derivative ............. 277 [J product symbol ..........-..0..0e ee 65 
(tt): pit Geri VANE: ocodoc akg esce 277 > summation symbol tie ider tenet nme a 47 
(8) Ft dativativer. «doe. cece sn 277 [ | ceiling function ................2.00. 421 
(00) bra vee cece ee eeeeeeeeeeeeeeeees 718 | | floor function .............0...e eee 421 
(a) cyclic subgroup generated bya ...... 107 ] 
ie scorn eas 718 Gi [Go] graph composition ........ 159 
4 partial Order sis cn ssos oie detaninwness 138 [, ] commutator .............. 95, 360 
© [vuw] scalar triple product .......... 82 
fractal arithmetic “multiply” ........ 25 [a0,.-.,@n] continued fraction ..... 30 
[jk, 4] Christoffel symbol, first kind 383 
eal Stirling cycle numbers ........ 146 
tat Stirling subset numbers ............ 147 
+ arrow notation ............ 0. cece ee eee i 


811 


812 LIST OF NOTATIONS 


> dfand only al 0. ccs eye ant swe 761 
<> if and Only dls sacs wee ka og saad domes 761 
SSAMPHES ind waite nicer acoretepomantadear 761 
— logical implication .................. 761 
0 | 

(), © trimmed mean ............. 581 
arithmetic mean .................. 580 
complex conjugate ............... 405 
U 
graph edge sum .................. 159 
STAPH UMON esse saalsindiancs wieost eases 159 
> group isomorphism .............. 118, 156 
= CONBTUENCE: ins csssd essed saa siee eee 28 
a-b vector inner product ........... 80 
group operation .................. 106 
WMNNer PLOdUCE cs cases doe edeeews 9 
fo} 
degrees in an angle ............... 425 
function composition ............. 394 
temperature degrees .............. 795 
traNSlAtON yi2..00 4 cla eva Med aes 203 
J 
a : definite integral ............... 291 
¢ integral around closed path ...... 291 
integration symbol ................ 291 
Vv 
Ved iversenctenss.s6 cidaseneaes wes 388 
Vc iact.ce seGeencka tases 388 
V? Laplacian ...............00055 389 
backward difference .............. 653 
PTAICHE js, cccrdosnaaiirahacwehs 283, 388 
linear connection ................. 380 
a 
bo + ae ee tr ... continued 
AFACHON js iaescaaassemantly 31 
SraphyjomM swssesiede. wwus sae genes 159 
group operation .................. 106 
pseudo-inverse operator ......... 94, 97 
vector addition .................... Fic) 
asymptotic relation ............... 402 
lopi¢al NOtAsduncontoosermana ts 761 
Vertex Similarity siccvsci cure dice ds es 157 
* 
binary operation .................. 106 
convolution operation ............. 496 
dual of a tensor ................2.. 385 
group operation .................. 106 
TOMECHON: 3.20 ise nadsielemeaeraienes 203 
x 
a x b vector cross-product ......... 81 
glide-reflection ................... 203 
Sraph Product s..c4 ssscxsavacieiedaaces 159 
group operation .................. 106 
PIOGUEE 5.0.5 cnetie de dnd endenarmentas 393 


Vv 
NO PICA SOR ws oeiiaoss Hawisides Paes aes 761 
pseudoscalar product ............. 360 
A 
graph conjunction ................ 159 
logical and 2 vsss.6:s pq obs esis eee dee- 761 
wedge product ................... 288 
| divisibility’ .i..6 cscs ese sissy ee ws meets 28 
|| 
determinant of a matrix ............ 90 
F202) 8) 010) i (—) ge en ae 157 
order of algebraic structure ........ 106 
polynomial norm .................. 76 
used in tensor notation ............ 383 
III 
I[|]n Zt norm ....... eee eee 80 
Willa 2? notin: ois ciseenacs cease os 80 
|| || Frobenius norm .............. 92 
|| [loo infinity norm .............0.. 80 
MOMMY. 3/0 ins eared aasesaepasae take 76, 79 
Greek Letters 
A Laplacian, o. 5:2 ie daw iiicdaeessinne walema id 389 
A forward difference .............. 184, 646 
A symmetric difference ................ 136 
Ac arg f(z) change in the argument .... 409 
A(G) maximum vertex degree .......... 154 
Pe ey 
Christoffel symbol of second kind . .383 
connection coefficients ............ 380 
I'(a) gamma function .................. 478 
Q asymptotic function .................. 402 
ODM eases nh ER ted Cathe GEN ye 794 
®(a) normal distribution function ....... 556 
© asymptotic function .................. 402 
Y(G) graph arboricity ................. 152 
a one minus the confidence coefficient ...588 
a probability of type lerror ............. 582 
a(G) graph independence number ....... 156 
a(k) function, related to zeta function .... 20 
8 probability of type Ilerror ............ 582 
8(k) function, related to zeta function ..... 20 
x/(G) chromatic index ................. 153 
x(G) chromatic number ................ 153 
y?-distribution ............00 0c cece eee 632 
x2 critical value ........000..00 0c e eee 628 
x2. chi-square distributed ............... 536 
6 Feigenbaum’s constant ................ 740 
6 designed distance .................24. ries | 
6(a) delta function .................020. 403 
6(G) minimum vertex degree ........... 154 
6z3 Kronecker delta .........05:0000 0005 378 
€i,---i,, Levi-Civita symbol ............. 385 
7) POWer Of BLCSE icicles nash coeewes 582 
n(x, y) part of infinitesimal generator ....360 


+ Euler’s constant .......000000eesee eens 5 


+(G) graph genus ...............00 e000 155 
+(k) function, related to zeta function ..... 20 
Vi SKEWNESS... he seco aces toaes show eeeean $37 
a EXCESS! 1 Sariasnster hah acew ie atcusevadgasucrs 537 
&(G) connectivity .................008. 153 
i (S) CURVatUIe 24 0c .tesopageeesacwen sus 267 
Ay CUMULANE © 60393 pk G de wate mee heehee mes 538 
» 
average arrival rate ............... 563 
CIEHVALUE: s oevigedagawmemseess 98, 375 
number of blocks ................. 172 
A(G) edge connectivity ..............08. 155 
A(G) line connectivity ..............02. 155 
ps average service rate ...............0.. 563 
POAMEAN, een t/orscseG-atnanausnseatema 537 
u(r) Mobius function ................... 36 
Lz, centered moments .................. 537 
Pp MOMENES 9 bias eat ed a Ngaaresats 537 
Lp MTBF for parallel system ........... 578 
tus MTBF for series system ............. 578 
v(G) graph crossing number ............ 154 
D(G) rectilinear graph crossing number .. 154 
w(G) size of the largest clique .......... 153 
? 
Euler:constant 6i5.6.0s.c0sessnasw as 18 
POIMEN TAUO! nists Mood Latetodd wes 16 
VALUE eo gitar daanaenn duothioie aired eine 16 
incidence mapping ............... 151 
FEM cesses sty iccndnd capiciey nusedreesncsine es 250 
$(n) totient function ................ 46, 117 
o(t) characteristic function ............. 538 
T 
constants containing ............... 14 
continued fraction ................. 31 
distribution of digits ............... 15 
AASHUNES sta s sista arch deo vcinhadie'e ei asae 14 
MUMBESE 4. sesec's naew es va ugradn ean es 14 
PSrMUtANON bs soause Sa ewa se 109 
SUMS INVOLVING: sis so-ueewsceveamies 20 
a(x) 
prime counting function ............ 37 
probability distribution ............ 565 
~(z) logarithmic derivative of the gamma 
HUNCHON soso onicacicpetinaands 480 
p Setver Utilization: siogesas dence Gade 563 
p(A) spectral radius ................000. 100 
p(s) radius of curvature ................ 268 
pij correlation coefficient ............... 540 
o standard deviation .................... 537 
o(n) sum of divisors ................020. 46 
O7 variance ..... 6... cece cece cece ee eeee 537 
o; singular value of a matrix ............. 97 
sj VAMIANCE 5.55.2. § cigs chaiecenigiw siege Sadia Gee's 540 
Gig COVATIANCE .0. 6 cece ect e epee cen g ons 540 
a(n) sum of k'" powers of divisors ...... 46 


7(n) number of divisors ................. 46 


LIST OF NOTATIONS 813 


(4) LOPSION, sacs cvewasensencene eeelieas o 268 
0 
angle in polar coordinates ......... 187 
argument of a complex number .... 405 
AZAD 3 Sos oh GS ce tees he wenden 250 
0(G) graph thickness ................002. 158 
€(x, y) part of infinitesimal generator .... 360 
€p quantile of order p ................4. 580 
¢(k) Riemann zeta function .............. 20 
Numbers 
()~1 group inverse ............0..20005: 106 
()~* matrix inverse ..............000000. 83 
Onull VECtOr ois siacccnaeodeweessnodadose 83 
1 
1, group identity .................. 106 
130) 111 ane ner rene ON eM rere Oren 288 
10, powers Of ............2020005 6, 13 
2 
24 power set of A ...........00 00s 136 
2, negative powers of .............. 13 
2, powers Of ..............04- 6, 13, 22 
DEPOT $2) sad seasn then escddisets dG deateel teed eal 289 
DASPNGTCs acid bait tues huise ds bialencese scaricare 387 
DES WHICH. o.a.s5.H.tis'< Sane Bandie te dalvaes 158 
3 
3-design (Hadamard matrices) ..... 180 
SefONMi ggod ions edhe mage eecsices 290 
S=SPHEIS vdassliciae-rewtiae wen aaoees 387 
360, degrees inacircle ............ 425 
A interarrival time ................0.0.. 562 
PATIIP ETO. 3, occ cars tisex teauicrziconsreobnarecniaiines 794 
A(n, d) number of codewords ........... P32 
A/B/c/K/m/Z queue ................ 562 
A(T) skew symmetric part of a tensor ... 380 
Ai(z) Airy function ............... 361, 466 
Aj, radius of circumscribed circle ........ 219 
ALFS additive lagged-Fibonacci sequence 570 
Ay alternating group ................... 108 
ANOVA analysis of variance ............ 613 
AR(k) autoregressive model ............ 785 
ARMA(k, /) mixed model .............. 785 
Aut(G) graph automorphism group ..... 152 
Aj UNI -VECIOP 5 acs eas nee caaecadeeees 388 
a.e. almost everywhere ................. 401 
aMamphtude os. ccwsdoeeeeowe oka eas 473 
an Fourier coefficients .................. 54 
Qn proportion of customers ............. 563 
APE AES UMENE: a's cvaess sss ynnie ein ane ears bear ess 405 


814 LIST OF NOTATIONS 


SB SETVICEUIME so da taswod tae less 562 
B(p, q) beta function .................4. 469 
B setiok DIOCKS 0.5 casas os eens. erates 172 
BFS basic feasible solution ............. 771 
Bi(z) Airy function ............... 361, 466 
BIBD balanced incomplete block design . 173 
By, Bell number occ ces ces ccea es anes 145 
Bry Bernoulli number ................0.. 17 
By, (x) Bernoulli polynomial ............. 17 
Bg becquerel ss. 3..cucdaneantenasoaaitias 794 
b unit binormal vector .................. 268 
Co channel capacity’ seis. Gesnget sed san sce 730 
c the cardinality of real numbers ......... 137 
C complement ..................0000005 136 
CCOULOMD nia cgicdeicovee nee aceaieences’s 794 
C Roman numeral (100) ................-. 8 
C(m,r) r-combination ................ 149 
cas combination of sin and cos .......... 504 
Cc complex numbers ..............-.- 9, 115 
C” complex n element vectors ........... 78 
C integration contour .............. 291, 300 
Ci(z) cosine integral ................0.. 490 
C,, Catalan numbers: ....c56s04 sea crea as 144 
Cr type Of Staphe i33.258 sas ensantena dan 160 
cof;;(A) cofactor of matrix A ............ 91 
cond(A) condition number ............... 94 
Op: CYCHG BIOUP: seen ance aces an ee cadns 109 
Cp process capability .................. 579 
C(x) Fresnel integral ..............0... 476 
c number of identical servers ............ 562 
c speed of light ...................0.00. 800 
CO CaNdelaneccvticdwnws cows tan est acuws 794 
Cn, Fourier coefficients .......6..000.00e ee 55 
cn(u, k) elliptic function ............... 473 
cos trigonometric function .............. 424 
cosh hyperbolic function ................ 443 
cot trigonometric function .............. 424 
coth hyperbolic function ................ 443 
csc trigonometric function .............. 424 
csch hyperbolic function ................ 443 
cyc number of cycles ................00. 109 


D 


D constant service time ................ 562 
D diagonal matrix ..............0...0.0. 84 
D differentiation operator .......... 350, 360 
D Roman numeral (500) .................. 8 
det(A) determinant of matrix A.......... 90 
Dy region of convergence .............. 513 
DFT discrete Fourier transform .......... 500 
Dp derangement i555 ges coabdon adsnee thos 144 
Dy dihedral group ...............0.002. 108 
d derivative operator ..............0.00- 207 
d exterior derivative .................0.. 290 
d minimum distance s 6.5 csc secceieneess 730 
d(u, v) distance between vertices ........ 154 
dy(u, v) Hamming distance ............. 730 
diam(G’) graph diameter ................ 154 
div:diver gence. .<5cssie saa deaaaedacn 388 
dn proportion of customers ............. 563 
dn(u, k) elliptic function ............... 473 
dS differential surface area ............. 301 
dV differential volume ................. 301 
dx fundamental differential ............. 271 
Op (A) PLOJECHON cs secs rg nee eeknwees 288 
EUG SEU hd vst tiie twat tes mei oaedas 151 
PUCVEN iat Ged tani etre wats ded eet 535 
E(u, v) metric coefficient .............. 271 
E[] expectation operator ................ 537 
EVECtOr OF ONES) i -ccssawien sede le ada eas 83 
OF UNIT VECO iss side aaa cecesic ages omiineatele ats 83 
BL EXD! siccsieonatasontarcosuees sesaeaese 6 
Ey; elementary matrix ................... 84 
Ey, Erlang-k service time ............... 562 
Hm Huler numbers. .cessccs anew caaesa on 18 
E(x) Euler polynomial ................. 18 
Ey, (x) exponential integral ............. 490 
Ep identity group ............. cece 109 
e 
algebraicidentity’ 2 cscicesieeses vcies 106 
charge of electron ................ 800 
continued fraction ................. 31 
CCCENUICIY ion s'es chor cesmslnamend ec 229 
e base of natural logarithm ............... 15 
e(u, v) metric coefficient ............... 271 
ecc(v) eccentricity of a vertex ........... 135 
€;1---i, permutation symbol ............ 385 
Cf SHOP TUNCHON: seiseees cached eae 2 475 


FP fatad isch ad bu aes ba ead cv bdetoboas 
F (a, b; c; z) hypergeometric function ... 
F'(u,v) metric coefficient ............ 
F(x) Dawson’s integral .............. 
F(x) probability distribution function ... 
Fo critical value .............0000 cues 
F. Fourier cosine transform ........... 
F Fourier transform ................4- 
Fwy discrete Fourier transform ........ 
FCFS first come, first served .......... 
FFT fast Fourier transform ............ 
F(x) sample distribution function ..... 
FIFO first in, first out ................. 
Fy, Fibonacci numbers ................ 
Fyn Galois field ...................65 
pq hypergeometric function .......... 
F’; Fourier sine transform ............. 
f(u, v) metric coefficient ............. 
f(x) probability density function ...... 
fx t) density function ............... 


G 


general service time distribution ... 
generating matrix ............... 


(21010) Oa a a 


primitive root .................. 
G(s) generating function ............. 
G(u, v) metric coefficient ............ 
G(a; z) Green’s function ............. 
G(x] generating function ............ 
G Catalan constant .................2. 
GCD greatest common divisor ......... 
GF (p”) Galois field ................. 
GI general interarrival time ........... 
GiPIDE <5 iskidetieametedg beeen aaah aesiee 
GL(n, C) matrix group .............. 
GL(n, R) matrix group .............. 
GM geometric mean ................. 
Gn,m isomorphism classes ............ 


Gy Stay. ovcrad iain tesa teed 


g 


determinant of the metric tensor ... 
MEIC TENSOF seed cedases ang mages 
PTUMULIVE TOOE coin ba eects 
gir(G) graph girth ................... 
g(x) generating polynomial ........... 
gd Gudermannian function ............ 
g’! covariant metric ...............00. 
gij contravariant metric .............. 
glb greatest lower bound .............. 


LIST OF NOTATIONS 815 


AF Mean: CUTVALUTE 3. vcd cd da coerce 271 
HT parity check matrix .................. rie | 
4 Hermitian conjugate ................... 84 
PL RENE! i. cantctiousiasiss gna eieeaennnra 794 
H (px) entropy ...........0. 0. cece 729 
H (a) Haar wavelet ................002. 789 
H (a) Heaviside function ........... 303, 404 
Ho null hypothesis ..................... 582 
Hy, alternative hypothesis ............... 582 
H Hilbert transform ..............0.000. 505 
Hy, Hankel transform ................. 503 
H;, k-stage hyperexponential service time 562 
HM harmonic mean .................... 581 
Hy, harmonic numbers ..............000- 47 
Hy (x) Hermite polynomials ............ 451 
vee ) Hankel function .................. 460 
H, (2) Hankel function ................-. 460 
AZ NCH hs ei Senter ddedeandanunn eawenie nro 794 
Ag Metric COEMICIENIS® s5:/ss00 ase 4 earcrae 388 
I first fundamental form ................ 270 
PAGSNUMy THAUIX. salons site se thane disede ot eed as 84 
I Roman numeral (1) ..................06. 8 
I(X, Y) mutual information ............ 728 
Gunit vector ........ 00. c cece cece ee ees 81 
II second fundamental form ............ 271 
Im imaginary part of a complex number . 405 
Ty identity Mhattix: 2.0.5 ovccsac ces es ceed 84 
Inv number of invariant elements ........ 109 
IVP initial value problem ............... 184 
i imaginary unit ....................000. 405 
PANLETESETALS: «ohne dasa na snaliawadeeieens 746 
BUNIEVECIOE: Sigs ighssa ene axes adenine ss 390 
iid independent and identically distributed 536 
inf greatest lower bound ................ 395 
infimum greatest lower bound ........... 395 
J SOTA LOL hos gsy dag See sbcugonsis avs nebte » 100 
VjOULC: «cheba ona oe aati d Hated nage 794 
JUNIE VECIOE ovine de acinreetosmaemacgns 81 
Je NOMA SU oi aucdnsatendereseaa dedsaadn 741 
J (z) Bessel function .................. 460 
JiUNit VeCtOn 2.si.ctncsidedsevegaaasenben 390 
jn(z) half order Bessel function ......... 464 
Jv,k Zero of Bessel function ............. 464 


816 LIST OF NOTATIONS 


4K Gaussian curvature .................. 271 
KK system capacity ..................00, 562 
K Kelvin (degrees) ..............0.0.00. 794 
K unit vector ....0..0..0.0 0.00 ce cece eee 81 
Kitab cdeccamacsuxcconamasn ee neues & 6 
Kn complete graph ................0.2. 160 
Kn empty graph ......... 00... ceee eee 160 
Kn,m complete bipartite graph ......... 160 
Kny,...,.n, complete multipartite graph .. 161 
k dimension of acode .................. 733 
(yt) Ketel i0spcenasateinnspendedaass 375 
k280n POly GON e's wiccwscoe seas seaweed Raed 211 
K Curvature: VECIOR its. ssichsaencke noes es 267 
KUMIEVECION 2 tc.545h is cdot tue ta etd 390 
kg geodesic curvature ................4. 271 
ky, normal curvature vector ............. 271 
Kg kilo gratin: os. s.s caine siheevaleranceecen’s 794 
Keg DIOCK SIZE ons. a eas cae ces awe waren 172 
L 

SCIEN csi hs aai dani wet cahaade 267 

average number of customers ...... 563 

Ven Gth pis see ee Sincere iasiutucs da ene 797 
L Roman numeral (50) ...............20005 8 
L(@) expected loss function ............. 783 
EA NOMM concsscainss ces arontemswe eee 80 
EPMO roa.s sid gina ae adenad eee raes 80 
L°° space of measurable functions ...... 399 
£ Laplace transform ................... 508 
LCG linear congruential generator ....... 568 
LCL lower control limit ................ 573 
LCM least common multiple ............. 35 
Lig (2) loparithtit p..S:csscomss asa neews 488 
Lig(z) dilogarithm ..................0.. 488 
LIFO last in, first Out s..6. 60s iaeeeaas 562 
Lin (z) polylogarithm .................. 488 
li(z) logarithmic integral ............... 491 
Eo (a) Laguerre polynomials .......... 452 
Ln (x) Laguerre polynomials ........... 452 
EP DOWN: senda nadceabes cine d ed ewiee dns eee 400 
LP linear programming ................. 769 
Lg average number of customers ........ 563 
Lie lA QOUP te sidehicwdahes eee walosces 360 
£(0, a) loss function .................08. 783 
MA TNS aiae ona bona ele tie 277, 397 
liminf limit inferior jo... .s0 sks sep eniees aon 
limsup limit superior ................... aon 
Mr UME goa das ahs, ctere sae cea Be nail. oe 794 
In logarithmic function ................. 422 
log logarithmic function ................ 422 
log, logarithm to base b ................ 423 


lub least upper bound ................... 395 


M 





M 
exponential service time .......... 562 
Mandelbrot set ................04- TAl 
TASS ans andinnecaceaassiceae tosaaiaatone ates Pict 
number of codewords ............. 733 
M Mellin transform ................02- 530 
M Roman numeral (1000) ................. 8 
M(P) measure of a polynomial .......... 76 
MA(l) moving average ................. 785 
M.D. mean deviation .................4- 581 
MI GLY Quant: <3. ine Seven es ausmaeans 564 
MIG (C/O Queue. Si00 iow oseseouncsanes 564 
M/G [co queue s.eiovscisiis jexemeo 564 
Mi MODI: do sis cso steed 6 
MLE maximum likelihood estimator ..... 583 
MLFG multiplicative lagged-Fibonacci 
IPENELALOL <3 is. warden. dia senidnnun cn 570 
Mi MYT, Queue ssi iis sieges axieinas cee ha 563 
MM [eC QUeUe 0. 65. custo do ceun sewine eas 564 
My Mobius ladder graph ............... 160 
MOLS mutually orthogonal Latin squares 179 
MOM method of moments .............. 584 
MTBF mean time between failures ...... 578 
m mortgage amount ...............0000- 746 
m number in the source ................ 562 
mod modular arithmetic ................. 28 
N number of zeros ............0.0020005 409 
INGWION sadtnaleaewsce chaiekatatsaauaa 794 
NCA) tiull Spaces scsvisccs siee ae eniteatadacrcins 96 
N(, 0) normal random variable ........ 536 
N unit normal vector .................45 ari 
N unit normal vector ...............0.0005 81 
N natural numbers ...............00000005 9 
N normal vector .........0..00cce eens 271 
WMCOME NEN ..:25. cou laedain tone araee oe 733 
qorder OF a plane. vis wevskoacind Sse wistess 176 
n principal normal unit vector ........... 268 
O asymptotic function .................. 402 
O(n) matrix group ...............000005 109 
Op Odd SAP: essaseaewiewas eee cates ied 160 
o asymptotic function .................. 402 


P number of poles ...................4. 409 
P{} Riemann P function .............. 361 
P(B | A) conditional probability ....... 535 
P(E) probability of event E ............ 535 
P(m,r) r-permutation .............0... 150 
P(v, z) auxiliary function .............. 462 
P(«,y) Markov transition function ...... 565 
PCr PerMANEN asevicc4a-easavaacaseasscondes 91 
Per(xn) period of a sequence ........... 569 
P(x) chromatic polynomial ........... 133 
PUPeb tsccsaicseschatenge an desha cies 6 
PID principal ideal domain .............. 113 
Pi‘ (a) associated Legendre functions ....487 
Pn path (type of graph) .............0.0. 160 
P&o8) (x) Jacobi polynomials .......... 451 
Pn(x) 
Lagrange interpolating polynomial . 651 
Legendre function ................ 361 
Legendre polynomials ............ 452 
P" (x, y) n-step Markov transition matrix 566 
P,(z) Legendre function ............... 484 
PRI priority service .................0.. 562 
PRNG pseudorandom number generator . .568 
p# product of prime numbers ............ 40 
D(A) PArtiLIONS a sav swecaes oemegeesnore 145 
Px yy joint probability distribution ..... 729 
Pr discrete probability .................. S37 
DRUM) PAttUONS ssi Modievaniewas odds ones 140 
Pm(n) restricted partitions .............. 145 
Pn proportion of time .................. 563 
Q@ quaternion group .................0.. 125 
Q(y, z) auxiliary function .............. 462 
Q rational numbers .................. 9, 115 
Q(x) associated Legendre functions ....487 
Qn cube (type of graph) ................ 160 
Qn(«) Legendre function .............. 361 
Q_(z) Legendre function ............... 484 
@ NOME scnstic wage widiahe ena gdsb dala sale 474 
R 
curvature tensor ...............0.. 381 
radius (circumscribed circle) ...... 213 
TAN GE 6 ava geaien sina drew minceioe sigecaraci vere 575 
Tale Of A COdE Hs venae scan oneenegvers 730 
RICCLONSON ..4csceseeec ews ve 381, 384 
Rigmann tensor iaicxsidsGecwes Sassi 384 
R(A) range space .....c66 cece ee cce eee ns 96 
R(t) reliability function ................ 578 
R(O, dj) risk function .................. 784 


R real numbers ..............00000 2.000 9 


LIST OF NOTATIONS 817 





RR” real n element vectors ............... 78 
R"*" real n x m matrices ............. 83 
Re real part of acomplex number ....... 405 
A; reliability of acomponent ........... ait 
R.MLS. root mean square ................ 582 
Rp reliability of parallel system ......... S77 
Re radius of the earth .................. 228 
Rs reliability of series system ........... SIT 
RSS random service ................0.05 562 
r 

distance in polar coordinates ....... 197 

modulus of a complex number ..... 405 

radius (inscribed circle) ...... 213, 433 
r(0, a) regret function .................. 784 
rad(()G) radius of graph ............... 157 
PAC TAMA 493 hs0g 4% ated neraewead tent aac 794 
r; replication number .................- 172 
r(x) Rademacher functions ............ 793 
SisamMple Space. vassc. cherioegesdaens-oe o20 
O LOFSIONAENSOL ois.5 sien saemnesldsie.tsiedalens 381 
S(n, k) Stirling number second kind ..... 147 
SSIEMEN soins s eave deesaseeseesuumnee 794 
S(T) symmetric part of a tensor ......... 380 
SI Systeme Internationale d’Unites ...... 794 
Si(z) sine integral .................008. 490 
Sj}, area of inscribed polygon ............ 219 
SL(n,C) matrix group ................ 109 
SL(n,R) matrix group ................ 109 
Opi Star STAPH gee. ge ica pans sw bowie Badadas 160 
Sr-SVMMEUIC PLOUP: os desis ecesidaeds. 108 
Sn(r) surface area of a sphere .......... 224 
SO(2) matrix group ...............008. 109 
SO(3) matrix group ...............000. 109 
SPRT sequential probability ratio test .... 608 
SRS shift-register sequence ............. 569 
STS Steiner triple system ............... 180 
SVD singular value decomposition ........ bs] 
S(a) Fresnel integral ..............002.. 476 
s(n, k) Stirling number first kind ........ 146 
8 

arc length parameter .............. 267 

sample standard deviation ......... 581 

SEMI-PETIMELEL 0 ceed es ede ees 433 
SiSCCOND 2.5 desig ices ewleumes tees teen 794 
sec trigonometric function .............. 424 
sech hyperbolic function ................ 443 
sgn signum function ................ 90, 404 
sin trigonometric function ............... 424 
sinh hyperbolic function ................ 443 
8, area of circumscribed polygon ........ 219 
S$; elementary symmetric functions ....... 71 
sn(u, k) elliptic function ............... 473 
SE StETAM AN iscsi aotes 06 sheave dunia gas 794 


818 LIST OF NOTATIONS 


sup least upper bound .................. 395 
supremum least upper bound ............ 395 
Pte interval, s,jiwcenmeoawe ns eoGsas os FoF 
AVTCSI AS * seysr cual ash Si tiscteee na Rink ba tea tes 794 
PATS POSE: s,s does drtasmeaadtoeaieene 78, 84 
MT teDiltgstivog.dccSormdaeebredaahiamsachuasane 6 
Tn (x) Chebyshev polynomials .......... 453 
Tn,m isomorphism class of trees ........ 170 
tr(A) trace of matrix A ...............0.. ol 
CUNIt tANPENE VECIOE esse tee dwws ces ees 268 
t-(v, k, A) design nomenclature ......... 172 
dy Critical VANS oo civic eda dana ees 628 
tan trigonometric function .............. 424 
tanh hyperbolic function ................ 443 
tx,y transition probabilities ............. 729 
UF UNIVEISE ods eis ede oe conacdaatercnss 763 
U[a, b) uniform random variable ........ 536 
UCL upper control limit ................ S73 
UFD unique factorization domain ........ 113 
UMVU type of estimator ............... 584 
Un (ax) Chebyshev polynomials .......... 453 
te traffic NtENSity: cows eases saggy Stes 563 
u(n) step impulse ..................008. 513 
Ab; CISANCE opined nedendevasitnnoncaheomstehd 388 
Ve Vertex Seb 5 ivids sete ide gel eahtet 151 
¥ Roman numeral (3) ..ccceseessecweenasne 8 
W WON 2 dean ninin S sniewde a lowes nase’ 710, 794 
Vec vector operation ...............000. 103 
Vn(r) volume of a sphere ............... 224 
W -averagertime oc. i:iia3 sack halen dor aus 563 
W Walt cicistiernet ede vnnetiow Sate seceine es 794 
W (u,v) Wronskian .................08. 358 
WD Weber iiss ctaieans aumadewaatanes 794 
Wn root of unity ...................08. 500 
Wr wheel graph... ...5 eseserbiee bes eans-cr 160 
W(x) Walsh functions ................ 793 
Wg average time ...................045 563 
X infinitesimal generator ............... 360 
X Roman numeral (10) ................005 8 
X() first prolongation ................. 360 
X (2) second prolongation .............. 360 


Li) i order statistic ..............0005. 580 


«, rectangular coordinates .............. 388 
Y_(z) Bessel function .................. 460 
yn(«) homogeneous solution ........... 350 
yn(z) half order Bessel function ........ 464 
Yv,k Zero Of Bessel function ............ 464 
Yp(a) particular solution ............... 350 
Z Queve- discipline: :...0..32saviwon et deses 562 
Z(G) center of a graph ................. 153 
Z(t) instantaneous hazard rate .......... 578 
Z, AMVC PETS! teh eel Ste astd a see nice tlegige canes 9, 115 
Zin, integers modulo n ............-0005- He bs 
Z @ SLOUD: isa tka aaGecaieinadantesteasina 108 

p integers modulo p ................-. 115 
2. HATANSlOMN: Loirdieiiearsadeenie sacioue wee 512 
2 complex number is ..6 cen. viesccceeees 405 
Gy CTCL VALUE coc bc cece daasweneneoss 628 


Abel integral equation .................. 376 
Abel summation ...............0.00 ee eee 64 
Abel transform ................2 0. eee ae 493 
Abelian STOUpS icc hiscicnssewaaterd 24, 120 
Abelian property’ 3.40.08 edvemiw door see 106 
abscissa of convergence .................. | 
absolute 
CONVETRENCE. i.e ane ceennnees 47, 508 
AeviatiON’ 6.064 5 cescaselese onseromeon 581 
CIOR scaicwiacia-eah aainiditeone mace 646 
TENSOR. ess Sock Voroninpewsyagaie ees 379 
abstract aleebraisiias. cca ctusouegestona san 106 
BOCEIETAUONM soci ccae cc daceanene 697, 797, 800 
acceptance sampling ................... 626 
acceptance-rejection method ............ S71 
accumulation point .................0.8. 396 
ACOUSTICS! ing. cia execs mance es auutlan cays 691 
actions; Bayes viicsiectekevsiesiagetaens< 783 
ACUIE ANGE cs.ccikies mewsdoerniesedosiaes 425 
ACUI HAN SIE: choy sess hares ane ds wbaoeocars 212 
aCy Che graphy Lisicn asi Veiga dey ieked vanes 152 
Adams-—Bashforth methods ............. 683 
Adams—Moulton methods ............... 683 
addition 
formula ca cies cases vevenveaeeasen 3,4 
of complex numbers .............. 405 
OF PACHONS? i.5 ccocka ts sh aannedrache ¢ 9 
of hexadecimal numbers ........... 12 
OF MAIS gsc sisc partes weeds sees 88 
OFIENSOLS! ns vein cela edd newaelees 379 
OF VECIOIS: fs. daspacias iaden vais eae es 79 
additive 
CONSIANE: cdc wax San wanbdcdaaes aes 569 
STOUPY Lot haa vnneer se Soh dhe 106 
lagged-Fibonacci sequences ....... 570 
adjacency matrix .................. 152, 1357 
adjacency of graph edges ............... 152 


819 


aifine planes: ccaicdeca ca seaneeees 176, 179 
affine transformations .............. 207, 256 
ALY CQUBUON pes.fs0cs 5 Messen dhaade gidweden, 3 361 
AMTY TUNCHONS: ei casi Seda jcas ease 466, 467 
Aitken’s A? method ................... 646 
Aleph: ull CRO) she eacehancansnaniaonemsces 137 
algebra 
ODSHACE occ ccadnaudagena cewawan sad 106 
ASIC: sc. s:Sevang an ened sale bhsdoad 69 
fundamental theorem .............. 70 
MMAXSPIUS: Moka sed sion nsereneseenaaaet 26 
WOOO! spp chin cusesvaeeeannr edawsens 79 
algebraic 
CUEVES? saire sists sivas sutenaie Adal cannes 240 
CQUALONS: 5 x.c:scatd saicted anne neces aty 70 
numerical solution ............. 647 
(=). 4c! 115) (0) | eee 114 
functions, series for ................ 59 
IMENUUES nies case es cvaeees 71, 106 
INGESEE seb acdacne sare eaxeeenes 116 
MUMIPCHy stndescennaues Seedcvers 102 
PUMIDENS a swccansadeedees eee anenrwess 9 
SUUCUIC . avuketneranagen sus wueues 106 
ONdEE syxsggovgatiacbidegenwece be 106 
algorithm 
assignment ..............e0e eee 716 
augmenting path ................. TP 
branch and bound ................ 7714 
classifying a conic ................ 232 
continued fraction ................. 31 
cubic splines ................ 655, 656 
design principles ................. 688 
Dijgkstha’S ccs cies czsiase touoeanegens 716 
Buclidean, 2.4.64 ceenececdevaas 35, 739 
fast Fourier transform ............. 502 
fast matrix multiplication ........... 89 
Gauss—Legendre double integral ... 675 
Gaussian elimination ............. 659 
BENCUCS iii ant deny ncehad boas weboedencs 7719 


820 algorithm 


algorithm (continued) 


GW 255s ce orhcpmcpadanes et vadcate 51 
HitOF MISS oso ee oe eas 677 
TAOEMEL S50 520,5 00 sien SPA ines edivornce ews 650 
Householder 2.00.2 i5 seats 662 
HUNGarian ....ecegsseeaesd veesaes 715 
inverse power method ............. 661 
Karmarkar’s method .............. T72 
linear programming .............. 771 
maximum flow ................60- Tid 
Monte-Carlo integration .......... 678 
NGVill 6: sidiehataadtioobedacdea a 652 
power method o.sc..cccasacincenee es 661 
probabilistic: <6... ccsne eee cnneneen 38 
SAMPLE MEAN spac are caw gecesi ae 678 
shortest path s.cscscsxneneewbnee 716 
simplex method ...............--5 771 
steepest-descent ...............0.. 667 
DifASSED: wake laetike cavetae 89 
Wilf—Zeilberger .................2. 51 
almost everywhere ..................00. 401 
alphabet 
and Shannon’s coding theorem ..... 730 
GIGek: sce. ncseaeateworiesasares 803 
SEQUENCES OVER oes. ciccicec ee coms oes 23 
alphabetical code, English text .......... 733 
alternating 
GPOUP) hic den wawinamedaoninwats 108, 109 
harmonic series ................ 47, 48 
path ina graph ................... 156 
SCHES 1ESE sisistaccakgredose dieses 49 
alternative 
Predholini 4.5 eh deadebav ace dances 94, 378 
HY POthEsi$'-....5:44 4i0e vials wearer nanscle 582 
altitude, of a triangle ................... 213 
AMPCIS? 193i sisce Mavsmauts Maree a ataem wens 794 
Ampere laws .ccionaswesG hana resven cece 708 
AMPH ods cient we tess eseeae cause 473 
analysis 
COMPIER eiicas nes serandwiiwlnidaots 405 
INCH Vall «55.4.2 nieve dnnehenivedeennes 24 
of variance (ANOVA) ...........-. 613 
(CAL facets sarcodnaenenpuen derma esate’ 393 
analytic function ................05 104, 406 
“and”, in propositional calculus ..... 761, 762 
ANGIES ec sniehiacws co ameeea 211, 260, 425, 426 
BCUIE) Maeda Arenivcaiate tun aude anv Daan eeearnahy 425 
CONVERSION seis vaccine cnven bas 440 
CONVER anncaaeaodecancnemeansewas 425 
difference relations ........... 429, 442 
GIFS CHO 55.55 5:0 casters dew gia seas tara acs Zoe 
BU EE iasnatsind al oa nroun inion tessepien’ 253 
EXtGHOl v5 wisebaaneaoy weemaan eens 28 
INGLE: sectrutetascviea denned 227, 430, 436 
in polar coordinates ............... 197 


multiple formulas ................ 430 


INDEX 
angles (continued) 
ODUUSG ii mintaneansasoapanearele sens 425 
PIGNG s iacmeeidanseewnagalee sae nets 425 
SPECIAL, get escroiatee eee cddevbnesd 437 
sum relations .................00- 429 
HISECHHG co.08 Sioa s ace aie wanes 242, 248 
angular 
ACCELETAMON: 5. sce a seees eae TT 
MOMENI ja: i:635 pasa csiearecaneae scdaleinteate FoR 
VElOCIY:? xe.ng oxeceaecuaismnene es 697, 797 
ANNUITY? oye sewisdins cha weerds edd aad 747, 733 
BINOVAS pies dons attee tied sotenie Ud prea saes 613 
antisymmetric relation .................. 138 
APOCHEM «5.9 dvindinee walisauipredinsndeweewers 218 
Appel—Haken four-color theorem ........ 163 
approximations 
Ad CHOPS i sa:c eee e ee seee bw geese 646 
ASYMPLOUC: str ievastedrisnesssraastetencbies 402 
least-squares .............00 656, 737 
HHEOPEM: 2 sicccdiad'c oes pasar mee ees 399 
arboricity 
BTAPDS! snrsataisse sta a irrarameneennncns 152 
HHEOLEM “i5).ajciecierascn eas ane ewen 163 
aC length: cc cnccceweseuawene s 267, 294, 382 
CICLO ae spetcograuerineie vores aimee ears 238 
PALAMSTEES sets ind sete Ba and isideseons 267 
Archimedean 
property of real numbers .......... 395 
SPINAL ie cd sGansacromnaraane dettenenele ace 246 
area 
bounded by a contour ............. 294 
CHOIE scsccnceacauddeew de 14, 224, 238 
CONG W.9a cde ie star ee tase wines 266 
CMIPSE ssi csneis gure sao bis aes aie 234, 235 
CMipsOid.s...2ccecdncesiehvaee dae aes 220 
PUSH sw iiiiccicca caste geese ane eaes 267 
POLYEON iiescscered cxscasemes wen 212 
random triangle .................. 544 
SPhEre! s:.\ 3s owecneianes es eetee ees 371 
SUPPACE s coreesstin ssa Gatssonach does deasyecace see 294 
surface of revolution .............. 219 
TORUS: So cuisnes adn e.dtdeacpachptenle Mom eo ato 
CHANGES +s Sasa hyn Secret adem teeandees 434 
MIALIOS iafp sdhanaecan aces sates: Mabank ce etroanats 797 
argument 
of a complex number ............. 405 
PLIMCIPle: sss Sos sds Guha veal aeinenes 409 
arithmetic 
fractal y:.2 nes oie eae Net enadebeenes 20 
geometric mean ......... 5, 48, 70, 400 
Unter yall. isis sis ieisies dielea! sans aie eaians's 24 
MEAD gicksipicingiecnsieaee wecoeten sions as 580 
MOdUWIAr: da sccaserehosusersseees eae 28 
on infinite cardinals ............... 137 
PTOSTESSION. soil sccociossenen sponded « 69 
SCHES nc canoes cad thea toraiadw anaes 52 


INDEX 


AMTANGEMEHLS. ois ovje cga ven oases we awe 144 
Altay, COSlAS!..3 nai tin.seunee ieee anansoas 786 
ATOW NOON: vec sdaenewieeeedeeeeesanes 11 
Ascoli—Arzela theorem ................. 399 
assignment problem .................... Fis 
associated Legendre function ............ 487 
associative 
interval arithmetic ................. 24 
LAWS! saiettacianteinnuatancniecin are 762 
matrix multiplication .............. 89 
PLOPEMy a retrssc saad wating Seances 106 
ASTOPDYSICS a isie dseswedacaeae sae eanee 692 
ASVMPOlE:c00.. be aseca adeveednndaedweins 231 
asymptotic 
approximations, of a function ...... 402 
CIRCCHON p03 4250 cv oiiaGueentanias 270 
expansions, of integrals ........... 304 
VG): 8 dy shad Bae ea ae aan 270 
POLAMONS fs SS EM ade ed 402 
atmospheric physics .................... 694 
ALOMIC PHYSICS) «6 s/c00ias sve adeaee savsedies 695 
ALOMIC:STALEMENE 5.42. aieergne dai anes areaiasacats 762 
augmented matrix ..................00.. 659 
augmenting path 
ASOT IM srcascuc cond sue seek aes TIS 
HAGA OTAPIA, oats is. Sel tel aia tease race as 156 
autocorrelation ................0005 182, 786 
binary sequences ................. 183 
COStaS altay™ .siccame dies nash ane eanee 786 
automorphism 
STAPH +s scieyunanntoawy es 152, 157, 167 
STOUP as.ekuwadveetneiareness 152, 167 
OF a'SWUCHUTE iced davtcaveebeanech 118 
autonomous equation ................... 356 
autoregressive model ................... 785 
AVETALCS ashanti asain deuau omnes 541 
axes 
Cartesian coordinates ........ 196, 249 
CONUSALE A. canads eee oesieeeee 231 
MAJOR dtied. asi ashartava care teaneeaones é 230 
TANSVETSE is oesiceeecedeennedases 231 
axioms 
completeness 0.065.052 .s8eee ones 395 
OF PEOMBUY wy 2enciaacaanaen onde as 193 
OMOLdED uSi25. Uses S gave ataweene 395 
AZIMUU i seirt Seweleediaediteden eewieenaw nace 250 
Bachet- equation 5. s.05 4:5 acesa.a we sed viet ware 32 
backward difference ............... 653, 679 
Baker transformation (chaos) ............ 740 
balanced incomplete block design ....... 173 
and Hadamard matrices ........... 180 
existence table’ ....5.:0.s0+0.e0008 174 
ball, iia graph si sccse cae kine died osanews se 152 


balls into:cells: o..05.4 asa dargenslegeeewnses 140 


binomial 821 
Banach: Space’ és .cls nesters Sass oe armen mewaceaes 399 
band-limited) :4-d36ss5 asia svationdene ween 499 
bandwidth jcccicesuegeeerayeaw sans Seseas 85 
bang-bang control ...................00. 734 
Banzhaf power index ................... 801 
bar COdES: :..2kccvisatadaesuianates see pate 804 
Barker Sequences: «i .s 6c ccekeeceeeceens 182 
base representation ................0.0005 10 
basic feasible solution .................. Ti 
DASIS Sansa ucees ves oe keeee wero mies 117 
Bayes ACUHONS 3 iiiS.5c58 acct nedna les eden sn 783 
Bayes tle: sstsissciasisem ate deat arose caarachapesion 536 
BCH Code ¢ 0405 ceseeanssaed see code, BCH 
beam dynamics. 65a weseicnousa ch cingewaree 698 
Bell HUM bers! 5.5.3: sg decpewanceas awacanes 145 
counting equivalence relations ..... 393 
Bernoulli 
SQUALON a.c2 hh wietids beh eau’ 356, 361 
MUMDETS 55.5 cede Asad Vackied ed 17, 60, 63 
polynomials: ..sc.ensiectesdecemeters 17 
probability distribution ............ 553 
Spitall aarat samen sigan teninne anaes 246 
Bessel 
Equation act nseiossiuneueeonekes 361 
functions ................ 53, 460, 468 
INEGUALILY? si vssvegiscciieisQvede’ eetvnaitecnd 401 
bestidecisiOn: ni cies csateadeed hes ehoaewate 783 
DestHtline .csccsecee seus ndeniaedertars 657 
beta fUNCHON: 54:56 ccois saan eiwateog ns 469 
beta probability distribution ............. 557 
BeZiet CUIVES: s3.cesnceasensvexcidekaeaen 657 
Bianchi’ identity: oi .cwictscstdeonieees we 383 
biased COM! j.0s.c5 okie wha a Gaeaneanaes 606 
Bienaymé—Chebyshev inequality ........ 542 
DiTULCAHON aks athens dateresoan esas 740 
biharmonic equation .................... 374 
bijective function ...................00. 394 
bilinear form - 5 ovssicsaccsdasues cesses 84 
bilinear transformations ................. 410 
billion, defiMed 4oodcacdasca cara ce eveaa on 6 
DID: itncgaminadie Oe es ecsees seeeaiendaress-> 580 
binary 
COGEN. clasgusuasaoeandeaene es 731, 732 
Hamming codes .................. 732 
TM=SEQUENCE: i s:d. sisiarncccorg coats 182, 183 
notation, number of 1’s ............. 21 
OPSTANONS 5 auch case eRe eines 106, 159 
PATHLIONS: 3 yscc55 Sek beeen 22 
polynomials ................. 177, 178 
FEPPeseNtallON cascsveiecssveunvesads 10 
SEQUENCES! s sieisih cas eaaeewe as 182, 183 
DING O1Card Seite cecnonnsoneseneacsnes 551 
DINOMIAl cnucieeiesda wiagsonnse seeaes 22 
GOSHICIONIS occ aes 52, 142, 143 
distribution ......... 553, 592, 620, 639 
SCHES (Oe cited cunt dom doen aeanen 50 


822 binormal line 


binormal dine s:5...053a cee seeae nee entans 267 
bintormal Vector sic. a2eaaienawaeiaacows 268 
DIDO SY a Kivendsaaskcomondlon dosages 699 
Biot-Savart law ................0.0.00005 708 
bipartite graph ................ 157, 160, 776 
biquadratic residues .................... 175 
birthday problem ....................... 545 
bisection method .................0.0004 650 
DLS: fs.520: a2 550-420ce se gthvaceitetsandeacpteieee ahasauats vane 21,729 
block 
GOUES ster iio a Sdcaaseasune eos 730, 733 
combinatorial design ............. 172 
CESION aus dcstein dane th ed anceede waa 173 
Jordans <i cov ccecridcennetandeadns 100 
Oh a Staph v5 swedsaaws oavdpendie 152 
Bocherequation: ».5.. sco .0csitonnewnceew 361 
Bolzano—Weierstrass theorem ........... oF 
| B00) aig [RR ra 668 
Borel, Heine— theorem ................. 397 
DOMOWEd is cicia dacnaiet adie ees cineicnse 746 
Bose (BCH) codes ccc0cceeceecedeeness Bl 
boundary conditions .................... 363 
boundary value problem ................ 376 
bounded functions: .sc.sceccsaccsueves 406 
bounded variation esc csws cous santas 494 
bounds 
BCH (Coding) ....ccccscsyeeye ences 731 
Chernoff (probability) ............ 542 
Cramer—Rao (probability) ......... 586 
greatest lower bound .............. 395 
Hamming (coding) ............... 733 
least UPPeL sesiediee's cuticles anew os 395 
TOWER Sanh Gusaa dexduad 395, 592, 594 
Moore (graphs) .............2.06. 165 
Nordhaus—Gaddum (graphs) ....... 164 
on the variance ................... 586 
UPPet wie tka sci eas 395, 592, 594 
Box—Muller technique .................. 272 
Diasec sshamasanned erkenestetecmenisies > 718 
Braess paradox wis cis css casas ees ents 756 
Brahmagupta formula .................. 217 
braid S1OUpS: n..<+.cidcse se ead pcak eed 1t 
Brawlescodercs.ccs./acep csp aeeion ames 803 
DEAK CE cer..cg araiace poesacn buco die tere yucaanseesatmaeats 718 
branch and bound algorithm ............. 774 
bridge 
Card Same: jo.gies cowiivioniaueteas 548 
bridge, Card Same’ oe vais cceayve a eateades 7 
bridge; ina graph -.65.ee ce tee ace enne dee 152 
Brooks’ theorem (graphs) ............... 163 
Brownian motion ...................04. 359 
Bruck—Ryser—Chowla theorem .......... 173 
Bruijn; ;de: SEQUENCES: sis. sacancea’s cee wo eae 23 
BTU CONStANbets.sihs.c.55 batted swore Ga ehaces ts 37 
BED oe rit ecicles A netantornh uci ndiass ta wate aeons 800 


Buckingham pt csi dewcise sins ols eases 7 


INDEX 
Buffon needle problem ................. 544 
Burgers’ equation ...................0.. 374 
Burnside formula for n! .................- 16 
Burnside lemma: .5.5 4c c5sea socks en ane 110 
DY Cees diachaie a aac tessctem ann eke wcirscsonnenie temas 6 
calculus 
differential 4.c.scoxpcsdensesatens QT? 
fundamental theorem ......... 279, 292 
of finite differences ............... 184 
PLCdICAL: oie sarees as seemaaes 763 
propositional .see propositional calculus 
VECO a 5.5. ca sinncedamneraneeeaces 283 
CalGAdatS)s..iccidedacatonsceeeaeaaes 27 
cancellation law ................--- 107, 113 
CANLOL SEE. hb aio diana ca hare ted dense btshotcsoseg 248 
Cantor, \GeOre 3)... Vath bee aval kates 137 
Cap; SPHEPE: <i sede veeniawagachesdeee 223 
CAPACHOTS: sco au danncsnegekeeacataves-ce 710 
capacity dimension ..................... 248 
capacity of achannel ................... 730 
Card PAMES? Jacicwictsvotueseoeesess 546, 548 
Cardinal ‘SEES ch scks sy acnssnaawany de pactades 499 
cardinality 
OF ASCE ncentne denidecueminniheshers 394 
OF INfiNite:SEIS:....csscs chveeyer anes 137 
Carleman’s inequality .................. 400 
Carmichael numbers ..............2.-0005 28 
Cartesian 
coordinates .... 196, 198, 200, 249, 368 
changing to polar .............. 289 
SYMMEUWIES: 55,5 capes peminnd ness 253 
form of complex number .......... 405 
PENSOR sia:2-crcrucesaatiaeaaingneae dane 385 
Casorati—Weierstrass theorem ........... 409 
Casoratian of sequences ................ 185 
Cassini’s OVAl! csc heea pecs sa beana oka bs 242 
Catalan constant ..3065 sce ice ces acy cece ees 20 
Catalan numbers ................0.2000+ 144 
CalGNALY hae saeuanchicweena Seumtereeenan 244 
Cauchy 
—Goursat integral theorem ......... 302 
—Riemann equations .............. 406 
—Schwartz inequality ......... 401, 542 
COMCIMONS : <5 9:5 85 sas) ase Sank waren 363 
CQUALON 3.2.25 ccdceeedacbaucscvewes 376 
MEQUALLY” 5.5.04 dones toa dees sabes 407 
integral formula ............. 302, 410 
integral theorem ................-. 410 
Kemell xing vcemouaeancenies aces 375 
principal value ............... 291, 505 
TOOUUESE? diesbeulicats wet edynaestvered tats 49 
SCQUENCE: oni. nce sepasacee ceewine ts 3o7 


INDEX 


Cayley 
—Hamilton theorem ................ 98 
formula (counting trees) ........... 167 
STAD! 4 4.82.2 varsenaiuhcirals Wiens ware euie 161 
THEGLEME fy scsi Nba tda ebay 118 
ceiling function .................0.2000- 421 
cells, balls into ...................0.0005 140 
cellular automata ..............00 ec eeeee 728 
EIST 25h siya’ esvierwesacensidiauce haraienee aliens alee’: 795 
center Of a:CIEGIE: 235 oxic ewenecdewe seas 237 
center Of a raph scat s idieesd Wes 153 
centered MOMIENES c.i5 cu ccucasaenseoees S37 
centering transformation ................ 772 
COMUMEIETS! 2... d.siace cance cdl aaire eine nse weiss po) 
central 
limit theorem: 45 o:-5.4:464 40 'bene ence 538 
MOMCING: jie 0 Nadenedscavdawaee’ 582 
QUMAMIICS) 5 ss tcc Saenenaad caus 220 
HENGENGY: hea besicae wee Rack eiaedes 580 
vertex of agrapht sic. e040 ce eecees ee 153 
certificate of primality ................... 38 
Cesaro summation .............000005 54, 64 
Ceva's theorem 602.46 sce nis sales eee iene as 215 
Chain: POsel: stdin ss ccaveeusnatawssases 138 
ChainerWle: aiidiscnae ve inndewece saws tae 280 
changing variables ............ 289, 364, 541 
channel capacity ...................0.0. 730 
CHAOS 1.5243 erect Wieca tsa teatuac ruatediBenrweds 740, 742 
Chapman—Kolmogorov equation ......... 566 
character, of a group ............... 118, 128 
characteristic 
eQuUatON: ciaivdscnaeenesaeedss 98, 373 
defines curvatures ............. 272 
defines damping ............... 355 
of a difference equation ........ 186 
PUNCH ON 65.4. ans pia’ ougretacesigcnaetaanase 538 
OFA MEME: oo. teicnncntocesaasasaaieaeeis 115 
polynomial jvsccccenadsus sans 98, 157 
OF APRAPh pi cee csde seuss 153 
of a shift register .............. 570 
TOOUS: saints tiara in evacotudcdandaendeaatbtacerane 98, 186 
characterization of real numbers ......... 395 
Chats; COMWON cscdvcoweawea sd anenes ace 575 
Chebyshev 
IMEQUALLY: Sasdiac cs iacusdenseutas 542 
polynomials ............. 53, 453, 671 
QUAM AtINE: ces hod cesharinese dare 674 
checkerboard 0c ccc ca cea cues ens 181, 543 
CHEMISHY” foi ves eu cata stieradedaeidhangiens 700 
Chernoff bound (probability) ............ 542 
CHESS ® sears iecesaisseaa.d.a quae idea nlwidcamiatere-sseaiawan’ 22 
chi-square 
distribution ....557, 594, 622, 623, 632 
(ESE gine a eixrdoianaea’ 603, 604 
Chinese remainder theorem .............. 29 


Cholesky factorization ................... 99 


clique 823 
choosing objects ............. 0. eee eee 142 
CHOP: 2:5-5,.dn vane naw asdameane a vatvanaac 238 
Christoffel symbols ........... 383, 386, 387 
chromatic 
INGER: pitied aie what sas es 153 
MOMDETS 0 cee ieee see scevenss 153, 164 
polynomial .................. 153, 164 
CIECIES 55:5: 5:08 ace wine dite Macpts ates Spanetaiars ahgoecs 237 
APC MSP 5 ciucowaidialacins-oatacetnateutes 238 
ALCA iid acs Gestiseweaieiceayea wie 14, 224 
COMEL ih ce Stade iota sesceasoutiten ded 237 
CITCUMPEFENCE: «5-645 :srerracdies ERG Cure 14 
circumscribed ............... 213, 433 
Gerschgorin theorem ............. 102 
WMSCTIDE ycadcawdadere veneers 213, 433 
MAPPING 55,0: sice saaaevemeewayn eae bas 410 
PONE ON. fad iia aacteeaan, aewntan ies 544 
PACHUS: oh akig ad dates datas alee 237 
circuit 
Bulenian’ ics e8 faced cae oh toes 155 
STAPH i ks ves tae awies cae ees eners 153 
TA STAD es sis Ses caks a aieistnd meee 162 
circulant 
SLAP so ncihreasaul sewers 153, 160 
MIQUI Sc Gcaweneaucunesae 86, 95, 153 
circular 
cylinder coordinates .............. 390 
error probabilities ................ 561 
FUNCTIONS 6. occas as 428, 443, 447, 450 
HER o-dusisdwraee nies ae braseareaatesuaes s 269 
normal probabilities .............. 561 
circumference 
Giclee athe aks 14, 224, 238 
CLIPS. caeededuslane satan useddees 234 
STAPH «<6 keiiar ews dactgicasieew dives 153 
circumscribable ..................00 eee 218 
circumscribed 
CUHCIE cvecccasueraxenews 213, 218, 433 
SPHELE: oie. ce wiema ede ee eeee es ees 261 
cissoid of Diocles ...............000 000s 241 
Clairaut equation ....................00. 356 
class equivalence: ..c.wwiscnevess veeaseses 293 
classic probability problems ............. 545 
classic statistics problems ............... 586 
classical constructions ................-5 248 
classification 
CONICS 553.4 SG Biase 232, 233 
BTOUPS tahini scans nooudes 107, 202 
integral equations ................ it fs) 
ODES 2 ircncasetslean aleanta meats 356 
BIDE Sy ito nctornae aise se aaetaehnes 362 
QUADTICS: ss icccuse bigs wnme youn ae eae 220 
Clebsch-Gordan coefficients ....... 457, 458 
CHQUE! s Bsterireciteieteh diets th cotati ted Boonie n te 163 
BADD) decks deb dunsstotsaniod tuastwncedeatges 153 
NUMBEL sos vac Moder saedsamaauccend 153 


824 closed Newton—Cotes formulas 


closed Newton—Cotes formulas .......... 668 
CLOSET SOUS ox dua dere hed deaveedee ranean 396 
ClISter POM wed sisdacvtownseeneados des 397 
OOS: er hice sal ted SADA GEG eal bedrehotoiretoee nm e& 730 
alphabetical, English text .......... 733 
DAR’ Syaysciateicnted Aovacnatninats Rare nchatis 804 
BOE cc Samant nietete caus a eaeadden 731 
BINARY is. aasestsa dite hs Ratome ea entens 732 
IIOGK i sisctesisana ncecegswtarsie word see block codes 
Braille osiscs gcse hse snake geaccdiecnas 803 
CY CHC HF thiacsstio Misi iubet ste baal 731 
CASPAR oes i bosehiehiy Wag isoeteth baden 731 
dimension ..................5 730, 731 
QUAL! scsesccsunt eonnie Coa asurelwiencdtavaeis 731 
CITOF COMTECHON: a. ccs: asic vve hca's Gee 730 
€tfor detection: v.55. ss cisedenee ne 730 
GOlay: -njnccsnddicde dion benes 731, 732 
GAY? cc Bachon Batcdenaed cess ao Rintoave anh ed 178 
Hamming oscch ccaceay cases 731, 732 
Huffman, English text ............ 733 
WGA sa eisa rend Rina in ntiandsinee tee 730 
MDS: ovwscisaredeencas see MDS codes 
IMOPSC! asissvviarsisaia's ne 8, demareaces- vied 803 
Perlect s.cccuumenteamunkiewacsues 731 
TC cokicckou wine ueeonewemmanene 730 
Reed-Solomon ................055 731 
SELF ital!) dcaraiecee Gzotiare warevoieovsiatecnane 731 
codewords ...............0085 730, 732, 733 
coefficients 
Clebsch-Gordan ................. 458 
CONNECHON ....50-.esiees eee ds ee nee’ 380 
polynomial, relation to roots ........ 70 
cofactor of a matrix ..............e0 eee ee 91 
COMMPPING, .susercsraserseree ce 553, 606 
CON. PrObleM8 ee vidcreusasseagedie oeediee 148 
collectors problem ..................... 545 
Collinear POMMtS vei iveecieewcowsoewees 211 
color classes of a graph ................. 157 
coloring 
BBLAPD asec. ds fait Anette bed 153,163 
ANECKIACE? chic scigowcdddnmdeadorues 110 
aregular polygon ...............-. 111 
WEED scasgd oh ce daa geadeee cea anses 110 
the corners of a square ............ 110 
column 
TANK. 3 sais hace dearndareetagataesedes« 93 
VECOM chia acseetihbai a ouha 78, 83, 718 
Combinations: 14 wcci seis stawsd dares daaed 149 
combinatorial design ...............-.-. 1% 
combinatorial sums ................0.0005 52 
COMbINALOLICS: 4 os saacd eee wie waste wewa 140 
communication theory .................. 729 
commutative 
interval arithmetic ................. 24 
lAWS > 33 ijatod-ed alee atin dawn. 762 


INDEX 
commutative (continued) 
regarding matrices ................. 89 
1 o) tt ee ee 113, 115 
COMMUALOR of iss see ck cee pete atorn aed ions: 95, 360 
compact 
SOUS. 2cisicvsc se ceednedarsietebw anes 396 
subsets, Heine—Borel theorem ..... 397 
comparable elements, in posets .......... 138 
COMpArsOn (ESt x... os sess Seek king oS 49 
COMPASS” cn siaeicn dessa ee mater ea swiss 248 
compatible Norm 4...4 ccs iideessannd oes oF 
complement 
Of a OrAPHy vies vacigs am onleieinde 153,157 
OF ASE .cenigenkevaneeetons 136, 396 
ONE'S: AN TWO'Sosi.0:. Sas ee camara oeacs 11 
complementary 
ESIGN ol itvenededtededeseden gets 172 
SEOK MUNCHON 4s icsasegs bande vais oe 475 
IMOCUIUS iit rire helo AA teks 471 
SlACkNESS 0. vice idescevadee sienna 773 
complete 
bipartite graph ................... 160 
elliptic integral .................0. 470 
GAP see mviecnaeawmeoe sone. 153, 160 
multipartite graph ................ 161 
orthonormal set .................. 401 
PIVOUNE? sn.cejaeibs ve ee sies seleaee nee 660 
SOU dine tia-ad divin linineis, dele eings iis eie 401 
SPACE sracrsrec sheers aged geainearecases 397 
completeness axiom ..................0. 395 
completeness relation ................... 457 
complex 
ANALYSIS: rates th Bie seh ede eiehend 405 
CONUSALE, sc icisetaceach deateancer 405 
FOUMMEP SCLES 2.6 cies isiednete eeelee’ 35 
AUNCHONS 4250 56.454 ohana keaewie tas 406 
ADALYUG: scans agielenedaeda ead 406 
transformations and mappings .. 410 
MOMDETS hc kas devnncevedweas ys 9, 405 
arithmetic operations ........... 405 
Cartesian form ................ 405 
Polar FOPM jess). syed Ve eneness 10, 405 
POWEIS Ghat ccomantern’ aonacttenes 405 
PLOPErtles’ 165.5 cpsayd em marseoees 9 
TOOUS. se.icadewentceiveswesseeaks 405 
LOOLS OF SI a Acacia wade aevedene 10 
component 
TUNCHONG fig doers d diac 267, 270 
Co) Ur Wr. ¢:| 0 eee 153 
SOMES 0.3. ofeas-tarcpoesuwusnaiuoihenss 47 
composite 
MidpomMtTUlEe: JanS se Gew ewes. 669 
MUMDELS 26-5 sia ciewern ahaa meth ae Mies ae 
SUMPSOM TUDE pcs ccigditas bac eeeee teks 669 
trapezoidal rule .................. 669 
composition of functions ................ 394 


INDEX 


compound 
event, connection to set theory ..... 136 
WTETES cc cecv odessa denne 746, 752, 753 
CIEL (=) 101 <) 11 Oe ee or ee ane 762 
compressive sensing .................004 J3t 
computational molecules ............... 680 
computer languages .................... 736 
computer programming techniques ...... 688 
COMPULEL SPCEd! vices cess ae eneee san cae 403 
CONCLUSION : ica-ccecusenewaaseceesee ee 762 
CONCUITENCE: 4 ss esuned ia hues aceal natee deen 211 
COMCUMOME 5.0). 4 ssecadcarnive htsadomseeie: deen’ 211,.258 
condition number ...................5 94, 95 
conditional 
convergence of series .............. 47 
GistributioNS 6 is eee ene es 540 
ExpectabOn siccvdse gece pesswese 359 
conditions 
BOUNG ALY <asaiachar certs teh a tiianet 363 
CaliGhy’ ns dacenataie erie tansnaseods 363 
DIN1"S: :..2.cndgateinesadeaerieh arenes 497 
Dirichlet 5 3s ssi:sne'snsie erase sa enact 363 
Moore-Penrose ................045 oF 
NeUM AND: oiosdencsewtacecwn esas 363 
TAadiawON: 5. So caves eens ee vent 365 
Separability: 5.35 5.4cs05 Gd sree tend mens 367 
CONE) ratacccnd dts Shaved nasseieamnsatwied 265, 266 
confidence coefficient .................. 588 
confidence interval .. 588, 590, 609-612, 614, 
619, 620 
for Mean seesgsveets saaes 588, 590, 591 
for median ccccccccsedeseweus 589, 591 
for one population ................ 588 
for quantiles 00000 sb cerca verces 589 
fOr SUCCESS chan disbaccescees 589, 591 
for two populations ............... 590 
FOF VaNANCE Ais isisagacdweensisneag es 589 
confidence levels is ccc cheeses smnerd 677 
conformal mapping ................ 410, 411 
COMSTUCNCES) fi ice wie etna bce watincd dies 28, 29 
congruential generator .................. 568 
conical coordinates ................0000- woe 
COMICS casa decensks dein csesa es bes 229, 232 
conjecture, Goldbach ..................45 37 
conjugate 
OKIS: cla ha vee teeuidehetmapemnsneets 231 
COMPIER 3 rt csssas Sycayh hin dea eadnenss 405 
hyperbola ..ta Sach Wad uae ce catea 235 
of an algebraic integer ............ 116 
conjunction, operation on graphs ........ 159 
connection coefficients ................. 380 
connectives in propositional calculus ..... 761 
connectivity .............2.00- 153, 155, 162 
IN BEAPISS 4 sessing Wash edadenen sts 153 
CONSISTENCY s.id bss casaoetdbeiaaie Masne’ 92 
consistent estimator .................0-% 583 


convex angle 825 
CONSISENES SIEM «2 5 sina dacscuacrnaeensess 94 
constant coefficient equation ............ 356 
constant failure rate ................00-. 578 
constants 
Brun ey ste cogeneration dain wanes 37 
Feigenbaum... 1..sccceeesnanceswss 740 
mathematics ..............2.006- 5-12 
PHYSICA << cg setulae nace tine wales 800 
PLANCK co s55.s cca sieracncetacs a acntans dundee 7, 800 
Special: “scctce-seaweda neues See cane 14 
contingency table .................. 604, 623 
continued fractions ...see fractions, continued 
continuity inR ..................00005. 398 
continuous 
BUA POME: 3,5, cpeneneaeican ai eeesenanars 398 
compounding .................0.. 746 
GIStrIbULLONS. p6. cesta ae wie ets 556 
Kalman filter occ sccsassscess 787, 788 
random variable .................. 536 
continuum hypothesis .................. 137 
contour integral 6 ccc sce vcnenaweseaaemdes 302 
contraction 
STADD tears encase ates ancegioa 153 
mapping theorem ................. 398 
Of a fUnCHON .s5frsaasae seca 398 
OP ATEHSOL cca xcitacua ctaaeeerds 379 
contrapositive law ..............0.0.2005 762 
contravariant metric .............0.0000- 382 
contravariant valence .................5- 379 
CONMIBULGTS 63.5 keaiaew asta saelee se» xiii 
control chats 3 ccsiehierdeeeneda eens 2 i is) 
COMPO MRED: sees ccdaeeuges on weigwede Se 734 
Control Able: 64.5 sc siiiucnarcba a tadulawey « 734 
convective operator ..............0.0.00. 388 
convergence 
ADSCISSA 6.5% sn sieuatacwaas acess sae 31 
BDSOIULES si. cei o.atscaianee Anns 508 
HPLOVUN Gis sic sisetonas ars win Ge boas Sine 63 
in TR. os sv nwsisusmunaetes seaswanes 397 
infinite products ................... 65 
interval acnisowinicseasveseuenseraes 50 
MING AR: %  sicetacstond hatin ediverin eitss 646 
of functions, in the mean .......... 400 
OF SCLIES! isin ci: exkGnae du wonders 47 
POMMEWISES S505 debe cissank Ma tisncebs sare sate s 398 
QUACK AIC! 23 ao owed dia beiseha des ohdd $025 646 
PAC OF. ics tiscela Weta Salah wed RY 646 
SLOW acedeccbe dotsactatetsias Waiheke acbosnacte Sat 64 
RESUS ceca is ance teateretedanacvesstenevventoteres 49, 292 
UMP ONT 555 scater aoe whee 398, 498, 499 
convergents to a continued fraction ........ 30 
conversion 
English to metric ...........0.5.4. 799 
from one radix to another ........... 10 
metric to English ................. 799 


CONVER. ANBIC nse ssc vidsivias caress deedns 425 


826 convex function 


CONVER FUNCHON: 55:4: H3:5 805 oe dead owas 400 
convolution 
Fourier transform ................- 496 
Laplace transform ................ S11 
of sequences .............04. 501, 516 
relation to the DFT ............... 501 
Vandermonde .............-.0+00- 142 
Conway notation .................0.0004 203 
COOKS Problem se. i.cee'esunaudwemareaas 552 
cooling schedule (neighborhood search) ..777 
coordinate patch of class ................ 270 
coordinate system ............. 368, 702, 703 
Cartesian .... see Cartesian coordinates 
circular cylinder .................. 390 
COMPIER, sosnd.nceoondiesedn se ameaank 369 
CONICAL. csdsgnh cna ine swatch nas 392 
eylindricall ig..cdnageveaus ohne 249, 388 
ellipsoidal .sssssa8 ths canes seis 392 
elliptic cylinder .................. 390 
homogeneous ...... 198, 201, 251, 255 
IN SPACE. sc Ss eaierties wands belesae ad 249 
MANIPOMY 8.2 ss:segcd needa saan oeaws 378 
MOCMAL 25a Sateen aces sive nd ceaslatnetares 384 
oblate spheroidal ................. 391 
Obliqué:swacdeuc enemas 198, 199 
orthogonal .............. 386, 388, 389 
parabolic ........... 367, 369, 370, 392 
parabolic cylinder ................ 390 
paraboloid -4.jc2n- 0s sivtnstiaancoss a2 
POlar oesccsedas ced see polar coordinates 
PLOjSCUVE .tuctucktatarsedepmnes.s 198 
prolate spheroidal ................ 391 
rectangular ......... 196, 249, 389, 424 
Spheritall 2. c0dadesedangeeaas 250, 391 
spherical polars... .cs00s.seee eon 404 
SY SUIS! ra aivionisraciin“asasieimaacesianp ays 194 
transformation ............... 253, 378 
coordinates 
CUrvilinear .3.ccascs ake ieee nee 386 
PAtAD ONG! sce siysseasscaeesn ans aseentsadotaded 367 
COPlaNAar ss cgccweeeesvewiees cameras eae 258 
Coriolis effect: 405.2 cpaseddiariaaneorsen 694 
Commu spiral: o.jcs:0ap sees grated ascayans 246 
correlation coefficient .............. 540, 609 
COSECANtTUNCHON: eesie Saco sso eaee ee 424 
COSEEA Sst betiens gamers hawenesne nae 107, 113 
cosine 
PUNCHOD; 65.0562 yne eR deny akies 424 
MNS ETA) tiers dane eins Veweenear's 490 
law Of COSINES o..5 6086 cb ceee eee 214 
tANSPOMM ois ess.ssi se aae ganda ieee es 519 
COStTUNCHON: 35:5 accion ytoRe eee ens 735 
Costas \aitay: scdicicca. son esees cee aaxe 786 
cotangent function .................0005 424 
Coulombilaw 5 esiw saad aeeveiededons ¢ 708 


countably infinite set ................... 394 


INDEX 
coupled analogues ..............0000eeeee 2} 
coupon collectors problem .............. 545 
Courant—Fischer minimax theorem ...... 102 
COVATIATICS 4.5) c.yaiscnce barnes de Sayeaecblens seta’ 540 
covariant 
GEPIVALIVE § antic esic. sated ad areie cua eitesas 380 
AMG ETA G25, 2.2 nig 005,42 hate ieee eee 382 
VALENCS. 5s. sigedeuie acocdesiwiecatiacaeeabiarsan ase 379 
COVEFINE SEQUENCE oo koi ideas eaw aeons 28 
Cramén’s TUNE 6 s.ccsswaacennae carne sose 102 
Cramer—Rao bound ...............05665 586 
Crank—Nicolson method ...............- 687 
critical 
CAMPING is)6 ie oe dese. d wlerta aieincnadeagses 355 
NUT G “scscasurg divs skachs Dis dysie ies vd: p alte aenaiter he 20 
POMS: hes esin senha ncaetencepewe 362 
PEOUON sis pares sianl igrcsieends dratenieors. igie Since 582 
ValUlOS, svedivacewnehtiodees cag bx henadui ee 628 
CHOSS=PLOGUCE oo.5.34.0 couch nwa AeA abe 81 
CTOSS=PAUIO.<.5.0¢- 03 nace + Hee Tada eens 411 
cryptography .................0000- 739, 745 
crystallographic group .................. 202 
CUBES avcakasewasaceer bisa oueasnaes 261, 264 
COLONES = 5 eniannamaasne one cies en 111 
CYCIEINIEK:, cada. coda ue darekeee 112 
BTAPH TYPO sinc succeed teeter nalenraness 160 
points within ................ 543, 544 
PLOPETUES: ea itcnd aneieionaieen ewok 262 
RUBIK 23.5 h2saes dices oun ae dame sadn 7 
cubic 
STAPH svsitcsits kaoweeourdawdes ees 154 
parabola «.n0cscneveaieiee sk eceseds 240 
polynomial ss is csevew cura dad 74, 743 
SPINES! ct xcacataruansabwas bet 655, 656 
cumulants and cumulant function ........ 538 
cumulative distribution function ..... 537, 621 
cumulative terms 
binomial distribution .............. 639 
Poisson distribution ............... 641 
Curl OF a: SPACIOME yess sis ie bela esse tenet bd 290 
Rel Vtd U0) 072) £2180) | Re ae 388 
curvature 
GAUSSIAN osc ceavecdenae eaawns 271, 274 
PEOMESIO f65. 0 sce sninwacnnsewneceta 271 
INVANIANE oj ocwietssaekaewisoathastcs 384 
WG vccavas ves inenndavenwnken 271, 274 
111 (CY: 11 ee 271, 274 
MOMMA ie Piceerewaks use ales’ 271 
Principal! sis c0da. ee qe dsecee 271, 274 
TACIUS 5 ie srrvcenutnsekainaynds gis area 268 
BONIS cs wine na cee se sale ewe oneal’ aay 267 
TEHSOF Sc dancwouaewauencs 273, 381, 383 
WECION Vi. cuseuet a ewhe enekacemecnd 267 
CURVES (lett nade acedeus pat sea ameate mugen bee 267 
AIBEDIAIG: dt.deh betel wdcdsesned 240 
BEZIER g.4-5/hescsdetecertcradit mittens 657 


INDEX 


curves (continued) 


CMiPle® f: dia 'cp tice Meee 743 
fractal cisisintcncwedeass eoetadae oe 247 
parameterized .................... 379 
TAtONAl (663 Gh Paa sb te a deasd baed aie 241 
HESUIAR i sive Sem ounsrad pian aias eaiharaoans 267 
SINGUIAR 60556 howler edardesege aeiek 743 
SpirOgsraphl ai iicecesensaagcvwas oe 244 
curvilinear coordinates ................. 386 
customary weights and measures ........ 796 
CUU(STAPD): sere csadiublaceteacetrane wera npe-eieboues 154 
CULSED ob. ates ete hunni hecinsativeaiies Hck Mi tea Fie 
cycle 
PTAPH sicsuule mado duannat 154, 160, 162 
Hamiltonian 23.4405 taccicetertes 135 
in permutations .............. 108, 146 
MIEN ca wseinecdee ced cnceaee 110, 112 
cyclic 
CODES: fi siting dane thant tine ete 731 
difference sets ........0000005 174, 175 
and binary sequence ........... 182 
PTOUP G4 siete hiwacacs 107, 109, 121-124 
Quadrilateral) j.:5 aise os sees vars 217 
TUG. nc reee asus Meamiaas ve eeu 280 
SUDSTOUP sesigecicides sabe den cones 107 
cyclical Adentity.4.cicchaohad eae nesouene + 383 
CYCIOIN aie cinco dared edie angco sein ematonete 244 
cyclotomic polynomials ................+. Ce; 
CYIMMERS' g.ren-tc ei as pane Raes «eras 265 
cylindrical coordinates ............. 249, 388 
aMPING cite esuaetadsadas aa tects 355 
ata PINS i cess srekaaen aeoesumaeee ees 655 
Daubechies wavelet .................... 790 
Dawson's integral: i..4ssc.aoreadsdnay eeees 476 
day Of WEEK csi nsdawiine aedslems-exeenes 727 
de Bruijn SEQUENCES. ..c. ees cs tes eee ee ee 23 
De Morgan’s Laws 
FOUSEIS A oiscsd awe enatnas semaayees 136 
De: Mortean’s laws: nicsseessdaienaes ea oe 762 
GECABOR 504 Sas cnt sha diate oti tba dedi edncncee 219 
GOCIG: os Sustasshae Guasave aceite alent’ 580 
decimal multiples ..................2.006- 6 
decimation 
IVEEUS: stesvsntsavudiceah yack 502 
in periodic sequence .............. 182 
decision 
DESH csciteaciaeendeweemaesene 783 
PUTICU OME 55 5 .seriss Sates asada dacsreon axete-t 784 
problems in networks ............. 715 
TUES: 5 caidaniurwaw chasse seman eens 783 
VaLlADIES cand eeunwa hes aednavens 769 
decomposition, spectral ................. 100 


deductions, in propositional calculus ..... 763 


deviation 827 
defective tems) 66.4 wiendacneesited aneeas 608 
definite integrals, table ............. 343-349 
deflation 
for finding roots .................. 651 
Wielandt method ................. 662 
degenerate COMIC ..65.054 cbeneaienraor ede 232 
degree sequence (graph) ............ 154, 166 
degree, graph vertex ................000. 154 
IG BTESS? 25, spur anette intare Sorewtens desman Mess 193 
ANGIE ss nsiigwanniars iarsagie we De tewd 800 
CONVEFSION 96.5.0) ss vse hctanccacharnes 440 
Ol TresdOH yadicciasaas 557-559, 613 
OF Latte cis «cis aals eeacdvo daa dmaweos 796 
fEMPCTALUTE: 6s paegcnrannador 794, 795 
Pelta PUNCHON. cscs ced ceed eases os 403, 404 
delta, RrOmecker cic cc caaeeukesaesoess 378 
DeMoivre’s theorem ................ 10, 405 
CONSE SE hho yds ahr Vie Ses RIA cred 396 
dense, property of rational numbers ...... 395 
density function ................... 537, 580 
denumerable set .............0. ccc eeeee 394 
dependent variable missing ............. 356 
GSpreciatiOn. .2: ssa asa sada 230 Lele 706 
eran SEMENtS: 2s sd ewenues wei svete 22, 144 
GevivatiVeS 6. ceccksngecseneaaseacens 25,277 
common functions ................ 279 
COMPIER: 5/c.6640 5. base esaradveeec te 406 
COVATIANE. 17.2 dis.caceaccn dante sient divrenis eine 380 
determinant 2.05.6. sc0 coe eheewes 286 
CMOIOR a .sudietaaued ead deedone 290, 709 
formulas’ 33 jc005 sie eewdeeaee 278, 286 
MAHI oy. o fh adnwedeaskanateedlonaes 284 
Pattiall sera tdeonaaterns acetidas 277, 280 
THEOTEMS) was. cnniGecheedakaansaen 279 
WECIOD’ Gosh acueabiwewae ded ene end 284 
derived design gissicvcccavegieseaeeaceee 172 
descent, steepest- .............. eee eee 666 
descriptive statistics: . s isjcackcsscusasewess 580 
design 
balanced incomplete block ........ 1%3 
complementary ................-. 172 
Gerived! a. dovscecauianndhedire waned 172 
CISIANCE: vices sae due deka wea wasese Wil 
POSIAUAL ids seins ayserhes spay be adarnaiers 172 
Steiner triple system .............. 180 
SYMIMEMIC Lirs5id wae eaiee eee Paes eevee 173 
HAG OLY 2 cence ewes seaceteed uae Wetton eoasetncs 172 
determinants: 05. ciaceveeiaad ena wes 75, 90 
and condition numbers ............. 95 
in wedge products ................ 288 
of sequence values ............... 185 
PLOPCTHES, aki sche we sexewewews 90-91 
deviation 
ADBONULE: os 4 acacia disnea one sud eee 581 
WNCOI sous ace hades da Baan ie Paste dee 581 
Standard 2.04.05 c00 ceaeeeaene 537, 581 


828 DFT 


DET 23. cia awl disamma trae saeenenes 500 
diagonal component ..................04. 83 
diagonal Matix’ 23 aves sdewiesdesnesats 84 
diagonalization .....................00. 100 
diagram 
Hasse'(posets): wis.cv sine nine naaccen ee 138 
OMMCES. ..2a0icsue aha cans agaes ees 170 
ETDs ssiciarcacans bhanecactevescssataconee S ecnge aim 137 
diameter of a circle ...............20000- 238 
diameter of a graph ..................0.. 154 
CIAMON sera daeadionhiied ode vcad wha whee 21F 
GOS it id saad hited eae eta etacke 549, 551 
difference 
backward for interpolation ........ 653 
equation .. 184-188, 190, 681, 740, 742 
LOTMA, oi. ss degassed ata snste anaes 679 
fOTWAL. i hiiey ced domes RELL akeee wes 646 
KEM! yesyuttion ink.ds cigs Beebe eevee 375 
OF ACUMENES skis AsoGa weds ines 445 
SCUS!  cacavaa sanw canecoatan serene 174, 175 
differences 
GIVIMER ise a gsi caauiceneewaarmeslias 652 
NUE: ise cvin'sica ats asics diets 184 
differential 
CALCUIUS S5.cSdaeeeeeeReoaeeee ae 277 
CQUALIONS: dri Patiha etic ta kocuaoeates 362 
autonomous ..................- 356 
Bemoullt: c.wisnceeas es hares ins 356 
boundary value problem ........ 376 
CMATAUE wep ccest ovsad-es shied ers 356 
constant coefficient ............ 356 
convert higher-order to first-order 
SVSLCM: beccheh en ea stk alt lesttens 684 
110) (=) eee ee ee eee ater 356 
CXACE sytinr deren iiarebalhe-casaes 356 
first OLE 53 oi socenoenasatee hac 356 
homogeneous ...............2. 356 
initial value problem ........... 375 
INVAH ANE sc5 yo sueces was eneor ae 360 
WCEP nites it wacom sess 350,351 
numerical solutions ............ 681 
ordinary ....see ordinary differential 
equations 
partial .......5 see partial differential 
equations 
stochastic: ...cscauaser cies oeuwee 359 
systems and higher-order ....... 684 
POPS). fs eon aa ahs alae 288 
BCOMEIHY a cccsvegienrevecswassnes 267 
differentiation 
COVANANE oi s:s.i5e!s5:caweaeaains eaens 380 
MUMETICAll 5 wesc warnseaseachese wee 679 
of power series ..............4. 48, 50 
partial, symbol ................... 380 
Diffie-Hellman method ................. TAS 


diffusion equation ............. 365, 374, 687 


INDEX 
digtaphs sripcniucdtonreumoened anise 154 
TUMDED IOP esiaisscame sane women e ees 168 
dihedral group ................ 108, 109, 125 
Dijkstra’s algorithm .................0.. 7716 
dilemma, prisoners’ .................00- 756 
GUO ATOM: ois i edctedinine nak rawenseracad 488 
dimension ................005. 248, 731, 759 
dimensional analysis ................... Fit! 
Dint’s: Condition sie iiea i cagsiewe cae acne wi 497 
Diophantine equation (integer solutions) . . .32 
Dirac delta function .................00. 403 
Dirac theorem (graphs) ................. 162 
direct product group ................0.0. 108 
direction 
ADISIES) os srsasciauecddiva asic nesta oeteasntersaratons 257 
ASVMPLOUC :c96 edonias.nachaehowiss, 270 
COSINES) cient icagt cee tend ee dea Zot 
Principal ssciowies say oe 271,273, 274 
ITEC: 5.545 Sa aN Cgc ahs 265 
Dirichlet 
conditions ..............e.e eee eee 363 
for Fourier series ............... 54 
SEPIES! 5.0 s:ccshieanearsewaasd ave dew ae 51 
HHCOLEM sie swis.d.nponacnna deecigistens tie BF 
discontinuities ............ 00... eee eee ee 303 
discrete 
distributions ..............0.0000- 553 
dynamical systems and chaos ...... 740 
Fourier transform ................- 500 
Kalman filter .. oc. cccscaecas 787, 788 
least-squares approximation ....... 656 
random variables ............ 536, 572 
GISCHIMINANE oe ig Kaskade dais s 73, 743 
of a polynomial ................... Fl 
CISGAaSS:. 5,50 c.c os.atwladicaacneenmacaamedee 586 
disjoint union, of graphs ................ 159 
disjoint, Witetnally: 6:5. ssc sisson ee 156 
dispersion function ...................0. 476 
dispersion measures .................0.. 581 
GISPlACEMENG ss i deine asad aes edregnetsene-4 787 
distance 
between point and line .............. 4 
between points .......... 210, 543, 544 
function, Of ASE oo cccaccorcacea ss 396 
Hamming si.caciecndossworers asses 730 
INPTAPNS 3.0 siesdatekbowiwse we 154, 165 
MIGASUTES! 4.3. incre barre he songs dagtaetidetpea’s 79 
minimum Hamming .............. 730 
OMA: s5:45 ses sunscunnerigean oan 228 
distinct Objects: 256 cease gc sae sa wenns 142 
distribution 
Y Lee ere ecm see F’-distribution 
Ei ecsiaaaa see t probability distribution 
Beto ics: citasbahndawes eee « 553 
DG ba snd Soivectacarecceatuneang eles noucnceyes Sot 
binomial ............... 553, 592, 620 


INDEX 


distribution (continued) 


chi-square ......... 557, 594, 622, 623 
conditional 2s csc0seeheuvesuvaes ce 540 
exponential ............. 597, 971, 578 
failure TIME sii cee yates eas kas 578 
TUNCHON 6c cacccaeeaseasiaes 537, 580 
BAMMAS obs eece ede ee neh nage sgaes 558 
BENGE, fe jo kiitos anise aetna 550 
PEOMCUIC his ctiie vega emesatewken 554 
hyPpergeomMethe: sc cos .05 csiie wastes 554 
MACINAL oyster urentosmenta nae een 540 
multinomial 45.54 ceadevens sabes 554 
negative binomial ................ 535 
normal j..iicrnseeonde ve 556, 587, 629 
POISON beca-bcadca-odaaurndees 555, 594 
probability, entropy ............... 729 
Rayleigh «csc ctie sedis sngaarnee 558 
LOSE iG tre Sautb et ai nat erecta 604 
UAE GIT iil ks Sed Hokus Lay aR aias 553 
Weibull sic nccesdaedenenate es Do9; 376 
distributive law ............. 24, $9, 113, 135 
IVEL DENCE? 4.5560 aig sels G22 sah athens Mwiaee 384 
OF ACU css ceeuciewalancenee snes 290 
Of a Vector (dV) cs cecses cvaseeed 388 
TOSIS: A viiewib aman sata denwosans eee 49 
CHOON fictidaadiscd bid take 300, 301 
divergent series ...............0.0000- 47, 64 
divided differences ................-..45 652 
divisibility of integers ................. 5, 28 
division 
of complex numbers .............. 405 
WINS ei, Sie Sais batiawengteteind te 114, 115 
SYNUNGHC i Aas wnat ety same 651 
divisors 
OPS sochewehsennedstek eres dees 21,51 
OF ZETOseiaine is siletaGaakle vans anes 113 
SUMOF sv esaecaisiessieeagaaian teeta 22 
Dobinski’s formula ..................005 145 
dodecahedron .................-005 262, 264 
domain 
Euclidean «.c52s0:4 sviad eaddgawanaee 115 
Integral: .4. ogcace ka wear is oa gees 113, 115 
OF AMUNCHON 25. onder andes 394 
principal ideal ............... 113,115 
simply connected) seaesdcsewneeae 410 
dominant sttategy’ 2s.sc.cei 0nd ede siead Kees 754 
Ob Product voces ices Vit eaten 2s 80 
double factorial is iis ciyccehsteiia octes Las 16 
double integral ................-... 674, 675 
double integrals ................0.0.0008 293 
OUbIN GE HIME? ic isis see as og as Rene Jo2 
draWwiNe STAPNS ci. soa swewstewaeens 154, 165 
du alicode 5 a. whe waeoa tina yevesienere seeks 731 
dual problem ....................0.004. 7713 
Cuality tHHeOPeM ssc 5.s caceggs. eee ees 793 


Duffing’s equation ..................... 361 


elliptic 829 


Dupin’s:indicattix, i. ci:0 casisaas venga 270 
dynamical systems ..............0.0.00e 714 
dynamical systems and chaos ........... 740 
Cait ovs em weiaaxmersan uae see notation index 
CC CETUP OILY. dalsdes de mratesusosetdtsteaetnusontiuetes Bey 229 
BRAD) occu sesh assed aansogeetarg Ruasebavateatidinn 135 
CCOMOMICS \e.ccvdnvdeatincdhesaemsansee se 705 
edge 
chromatic number ................ 164 
difference: ...codescesteevangsees 159 
iN, STAPH Jsicib.cends. 151-153, 155, 158 
IN POLY BON sevens iidvertcneeaeys 211 
SUM yeh. tos soos e teeen tunoenateanmnne Rec tetaeas 159 
efficiency, Pelative .....30siaateadndeme neces 583 
efficient estimator 0.00.2. enna eens ema 583 
CIDENSMUCHUITE ss ieive se astcnme Miadaemnelgu ss 98 
CIDENVALUCS eniiwscaakeoys ususens seneae 98 
COMPULALON: s.cndiouseaweseuancs 660 
difference equation ............... 186 
of an integral equation ............ 375 
of graph spectrum ................ 166 
of specific matrices ......... 96, 98, 99 
PLOGUCE Saux esrawaydendane-eyaannts 98 
SIGNS iacan con mecmsenaaiatdead os 102 
SUM Gv searsiical ead acaneenasoameme sue al 
CIDENVECLONS iBone Ode bata he dates ks 98 
COMpuUtalION 14 iss cabs ad eas 661 
Einstein summation convention .......... 378 
Einstein tensOr ...4 ces cenceae eens’ 384, 387 
electron Charge: «(ssisatern Koi as esate Baw 800 
CLSCHONICS 5: 55s caesar bk sales eae Dae eae 710 
ClECHOSLANCS:...iicesiccneednsenssaee esas 708 
elementary 
event, connection to set theory ..... 136 
MALHICES, san, ck civinid 49 34 Spee Gaertn 84 
symmetric functions ............... 71 
elimination 
GAUSSIAN) 6.0.4 peas seccaacae nae ares 84, 659 
OPCASES > s cide setsigeudeciemem teen + 762 
CNIPSS iss itn tee tA eae ceo Ol 229 
ANCA 28 cack bs aohlavhs abs ae cede acashoaee 234, 235 
AKES) ca Kad va pek sien Gann eawrtaenaa 235 
AMAPINALY sce esis esa wn mnawnee ed oe 232 
PLOPETHES) soi sis cna aut ae ety se ees 234 
ellipsoidal coordinates .................. 392 
elliptic 
CUIVES kicicheacaovesvasueueuowasee 743 
cylinder coordinates .............. 390 
CQUAUONS cc c.jacdaeciinnhas ne wes inac 362 
functions .................00. 473, 492 
INEGTANS, jiewsieesvcncayeceds 470, 472 
partial differential equations ....... 686 
PONE dices cagceBamsdgaveswsiedsce tie 270 


830 embedding, graph 


embedding, graph ................. 155, 165 
Emden-Fowler equation ................ 361 
EMPEY SLAP» s-c:s sonecdaraesnesoo wade syare-viane bakes 160 
EMPL SOC sick eek dv gia td ceca acenahis seers 133 
energy 696, 701, 704, 708, 710, 714, 723, 724, 
TST 
English text, coding ...........0.000e00% 733 
BMS LISH UMS sg cacsscetasincis.n datetime antes 799 
entire MNCHONS 0 ccacsaseacaasesuce 65, 406 
entropy of a distribution ................ 729 
enumeration of graphs .................. 167 
SpidemiGlOgy vewisscsacvnweyeres wha exes 711 
equations 
algebraic, numerical solution ...... 647 
Bemoullt’ 2c:hcne sa vionidnntmvaacues 361 
DinARMOMIC: 2: iacaedenna sess saenenos 374 
Burgers? -scsidivawiideaiendewedass 374 
Cauchy-Riemamn ................ 406 
Chapman—Kolmogorov ........... 566 
characteristic ........ see characteristic 
equations 
constant coefficients .............. 351 
difference ...... see difference equation 
differential ....; see differential equation 
CIUMUSION Sansehbionemneee weouoete. 374 
Diophantine (integer solutions) ..... 32 
CMIPlC: 9245s ckcwvdewdd nda mdm eaaoe 686 
Euler-Lagrange .................. 303 
TSA ye creates tates ooh ekicaas 709 
GAUSS! oso satanicetone's avian atane ue 4 273 
Hamilton: {gavage oedarser de wstasuds 701 
Hamilton-Jacobi ................. 374 
ING ab os. Pi aii ve ahisoed Seta ented 374 
Helmholtz .................. 367, 374 
hypergeometric .................. 361 
integral ......... see integral equations 
IRGPIEE. «tscrseasescatsaycts arene ae 692 
Klein—Gordon ................... 368 
Kolm0S0rov' (i isii cise sien cas Seas s 359 
Korteweg de Vries ................ 374 
Lagrange oi. cise cea cnecsmarenes 701 
LAME a.e's ciehe vis s Spee Caivows aetem ers 386 
TeaPla@?: <vy.c.2-c aided mdi duannearcerntars dacs 374 
LEGCNAKC! Sopa. ciccaiis oe aergainue sete 361 
NMG AR sci ssrntie tts cistebe es Hae tee sad 94 
NOPISUC iss. Sauter ite Sauce dew as hee 248 
logistic, difference ....... 190, 740, 742 
Hamed jc heskadas boda 361, 374, 376 
NAIC i ad: dae eatin calean cates eaes 722 
Navier-Stokes ............... 374, 712 
HOMUAl 6 6caccsadauend aanleues 611, 656 
Pell Accaseucceutead aauauaknaes sees 34 
POISSON . sexcdas ccenewnewew en 374, 686 
CQUAGEAIG: b-. sv Sasd sin Biv ematuatles 232 
ICCA ca siuisadcselsacd wind ve 189, 361 


Schrédinger ................. 374, 717 


INDEX 
equations (continued) 
Serret-Frenet ..............00 000s 268 
Significant: 2222 exetacunesaeiweante 417 
Sine-—Gordon ..............000005 374 
solving systems of linear .......... 659 
telesraph Mices.ce ceesde aie edinewdacts 374 
TRICOME? 5 oa5 id sig nad racien a earn dace 374 
WAVE? ss sis anariesacyite anor igtaiacace Sec Simard 371, 374 
Well aren ssc. neais teas vaaineknas 293 
equatorial Plane: sd sorte crocs sine x viens wine wis 250 
equilateral triangle .................0.0. 213 
equilibrium 
solution, difference equation ....... 184 
zero-sum game .............. 754-756 
equivalence 
asymptotic . see asymptotic equivalence 
CASS. xc dawadened ede seaeweke 110, 393 
of a parametric representation ..... 267 
equivalent functions .................0.. 401 
Erlang formula: .osc ances eee eds ges ea tere 564 
errata, website .............0.00 cece eae xii 
error 
ADBONUWIE: oo csiccewrasadaen sa Varese e 646 
circular probabilities .............. 561 
GCOMECHON! 5,3 cuss camancae ca sua aes 730 
detection’ secs dye ses ek demas 730 
FORMU vc ees peacdarckenesns 651, 654 
HATCH ON. ang. 6) '.ctatend ch vos depsalioue aie deo ook 475 
Jeast=SQUaTES: (ici vceci ee ce eae aiee 656 
MEAN SQUALE: 54 coved cuses do oene ee 401 
minimization ................0.0. 656 
of estimation ................00005 620 
TELALIV ES: x oti uMvcsives asp WN ARS aces 646 
TOUNG=OFT 4.0.hSexbine was deveatear arn’ 646 
StAMard 2.3 stata beni dain Mhecarensed 609 
types Diatid Tics sisunsemelasamaes 582 
escape set (Cha0s) sicivcicscaseweccsems 741 
essential singularity ................0... 408 
CSUMALON sss. s ona deeiad aaa eee wes 785 
SUI S cisica te assernrde arcs sea seh aoreenie ace as 582 
CONSISCENE «gai. da tide oulslessax'iechien 583 
CPACIONE ite sz.chs sn dcrasece ech vot Sutton a fies 583 
larsesample: ni incencdrradecinadtnas 585 
maximum likelihood .............. 583 
MICO, oh Grit sane wu one eee tee 585 
SMall sample: scecissGamisecdl ogee 585 
standard deviation ................ 585 
UMDIASE 5.63 soby 8 sin shows aca. dea) ats yoden 584 
VATIANCE: ois becwisiaeeig eed sale ene ead a we 585 
Euclidean 
AlSOTHM: wip ase en sawensie ovals 35, 739 
MELA 5 sida cocastee weigher ears 116 
PCOMEWY ees ba esac een oes 193 
WOM 56ciciectid idee 80, 399 


INDEX 
Euler 
PAMMNCHON saciacanvecaveves 117,739 
—Lagrange equation .............. 303 
—MacLaurin sum formula ...... 63, 688 
ANSIES! cu Reisen tienccaneanuce ew peaches 253 
CONSUME ciccscivscensednsae nee raas 15 
SQUAMOM 60.55 hake deeede aves 32, 356 
jo) 100101: ee ree 261 
MeO scsascesadsraveawees 681, 682 
MUMDETS. cc .seacesaeaciendeccns 18, 60 
Polynomials: 66 cesar pete ice eau 18 
HHEOEM 55 dss cascneeety doeburenl aes 162 
totient function ................ 21, 46 
Eulerian 
circuit ina graph ................. 155 
BLADI 29 s9nkss peer sapeca dese neonates 162 
trail Ina.eraphi sesiedsdevadetcbews. 155 
even 
BAP re sas teaeveecs wht aceauds tess eicsear ease 155 
harmonic series ..............-.-05 55 
permutations ..................... 108 
SVEN Misia teg ten iaqi aldara aatiarswalenr asaanace 535 
probability ...... csc se ees a vee 136 
everywhere, almost .............2002 eee 401 
exact covering sequence ................. 28 
exact differential equation ............... 356 
ERGE] cb aseied 35-485 cope eneraGnaakawedae 727 
EXCESS: in 5c gsach cearnuas aaiere dere mar einbcamers D500 537 
excluded middle, law of ................ 762 
exclusion rule for set properties .......... 139 
EXCIUSIVEO! acitsdentamenecdawnd sda see 569 
EXISLENCE isis: csscatntdernie 363, 497, 503, 505, 508 
solution to difference equation ..... 184 
table for BIBDs .................. 174 
existential quantifier .................... 763 
expansions, asymptotic .......5 see asymptotic 
expansions 
EXPCClAUONns cS us ceo edecemasewenee Sa7 
conditional cise wows bdseeusteares 359 
connection to set theory ........... 136 
EXPliCHe MEMO .o0 v.cciewwdeadnsakaasenes 683 
exponential 
distribution ...... 0600050 es0 ee 571, 578 
Foutier series: oo. ii sscaaved secede 33 
function ..... 15, 59, 422, 423, 428, 450 
inte stall <a cawnswadewees deoxees 490 
MM AUIN ci ocsasce anareuncions a asstetanttach Ueere 95 
probability distribution ............ SST 
SEEVICEMIMG 14.44 sae edesaenakete edad 562 
CXPOMENAHION civecicacsascagesecwanaa we 421 
CXPOHENS sc sccswieland Sane eu geeaadas 177 
AISEDIAIC: sc: sdiaccsus aeons oumeN ee 69 
dimensional ...................-- 207 
extended Kalman filter ................. 787 
extension fields itscis nay deeiady dudes cerns 115 


filters 831 


exterior 
ADSI S: searscasiss is ssotiate rate ean barre aranolas 212 
erivaliVe c.ascicseevecsceses 290, 709 
PLOGUCE. 52 cured specs kines head Sapiens aan 288 
extrapolation, Richardson ............... 646 
F-distribution 
probability cnc.s cs ecavdw runner ene 558 
ABIES 25, sicvsccteralarcanSeaehie nnraratme sd 633-638 
factor 
STOUP!. cecoticepeeie vedas deeded 107 
IMIS STALNG) silo sie veeecannees gat 
Of an sraph at ssenies tet foes stanton oases 135 
factored ‘staph 34 suite ed estes 135 
HAGLORIAL! «cso asecass ng Rite eee nd aranschiate ge nce iare 2 16 
polynomial .................. 146, 147 
PLUMES 45s sfesiesl ania nates has santana 40 
SHIPED a 2:siineigc curewanaots ta eae tures 52 
factorizations 
ChOlESKY a 4sheb bostyd doveeaay e) 99 
WOOT os eed ae taanaialua kek 99 
OR aiaike nda tcndchondaotivarnke etraetvaass 99 
HADIC? acing chided dnnasou mawGenceans 44 
UMIQUE: sic ssn dina ce aenaamaeaien 116 
Fahrenheit 2.6.0003.d-c.6:an0 soe aes ana eae bate nace 2S 
PAUUTE® os. . ges lawned dee abiee ed wie ses 578 
PAU TAtES cess hse bas es GNIAR kaye 578 
false position method ................... 650 
families of difference sets ............... [Wes 
Fary embedding (graphs) ............... 165 
fast Fourier transform .................. 502 
fast matrix multiplication ................ 89 
fathOmed sé secs. acace ene caotagrsa doen Seana 714 
feasible solution, linear programming .... 769 
Feigenbaum’s constant ...............-. 740 
Fermat 
—Euler theorem ...............0.085 29 
TAStMNCOPEN, 4.4.6 cc via ssavddseneasen 32 
PEWMIES > scsi 3a at tpacacae sone Dhc.at 40, 248 
TheGrem ccc keececcsecweds 29, 38, 763 
FEE ocak cunsaea vik aati toa Sane Medel S 502 
Fibonacci numbers .............. 18, 21, 186 
TEMG» 5.qnie vice kde anerotaRondaRenamaeee 115 
EQUATIONS soos a awe tee dhee heen dene 709 
Buchideah 5. s0in5 5. 24a valet sine leciteeyene 116 
PIMIUE ais caee es se al aracts Blanasaide arnt on arentare ays ilk 3 
GalOIS ig cniensdans coda wees cs 117 
QUAMEANC: sshd aciiuvowmanateer ee 116 
SKEW? facies sscuisundeyrnotsane dia caatiscanane dovead 114 
Heures MSE vis dcsavne Sees nernanediaiares 809 
filters 
KAM: oa cncaueenragemed ade awed 787 
MAGhed bs.50.45-casdonaemaegeaee das 786 
Optiniall 2. cose gciiaiduente ds seme ees 786 


832 finance 


AINANCE 5 ...5ic raw nardis dase eieasaanradoas 749 
financial analysis .................. 746-753 
finite 
cosine transform ...............0 Si7 
GUTSTENCES 4 cau oa Ldaceeuaadaa 184, 686 
EXCCNSION: ji¢'si.e aicemanmnderantmane 117 
PEAS * osc edecasies dds ches nly, 197 
BEOMEUEY: 5 sc3% scsi aye sepislatansreareamies 176 
SOl essa Regu owed neeKhegacwhe vans 394 
sine transform ................0005 ot 
first 
come, first-served: ....csa csc ccsaase 562 
fundamental form ............ 270, 274 
1, THISEOU sicccas can cee sedeveavieaes 562 
kind integral equation ............. 375 
Fisher inequality .................. 172,.173 
fixed 
point iteration ............... 647, 648 
point theorem 20... .06.666. 04s 398, 647 
points, in logistic map ............ 742 
flat manifold :...0.62:scc00casuiasamecaana ones 384 
HOOF MUNCHON 6 .isisn55 aeisgincvele nese ans 421 
flows 
maximum network ..............- 770 
solution by linear programming ....775 
AMUid MECHANICS: sushi sera sade weds Hee es 712 
TOCUS:. 4 ocndievdexddadustindda vtwandes 229, 230 
folding stamps, number of ways .......... 22 
folium of Descartes ...............00005 241 
TOO POUNS: 68 bn4 auecineiey sc dag en eye 800 
FONCE wlenssesdes 694, 696, 697, 708, 722, 797 
forest, spanning, of graphs .............. 152 
forms, differential! .cid6 ous cue aaiensaas 288 
formula 
Cayley” scm. tawne sspamslegsamsaers 167 
PD ODIMSKE 5:5.- 5:0 Gs. s0eare aden waceoonas 145 
Pole yy” 6:...:0s 5 nme canlenane mae tes 239 
QuUAdraliC:..ctcceesusewacnumnsaewe 73 
ROGCSUCS) csasiwattouts cece se ousoe 293 
UTNE sera seides atonement asetnastieees 479 
forward 
difference 6.06. cceenec ce 184, 646, 679 
Kolmogorov equation ............. 359 
four-color theorem ................. 163, 166 
Fourier 
coefficients .............. 54, 401, 402 
cosine transform ............. 499, 519 
EXPANSION s.dvvieccduie dens je sti s 462 
SELIES. cic cacce eens 54-56, 401-403, 514 
SINE SEMIS soars siannsa isle aodianniare bares 403 
sine transform 5 ..6.4cca scenes 499, 518 
SPECHUM: fossivconsikoseeuxere aes 55 


transform 357, 404, 493-496, 500, 502, 

907, 512, 320, 521, 338 
multidimensional ......... $02, 522 
Fourier transform ...............0.00005 516 


INDEX 
Fowler, Emden— equation .............. 361 
Hractall Zcyewanaanvadeeanta aaa 247, 248, 741 
APIMHIMGHC asad icdwals cng carg ee die we 25 
HAGHONS). 355 dase pdt arundel ¥ wad sons acsacece 9 
addition and multiplication .......... 9 
COMPAPISON: 4 ccsseouadranesiad edeace 9 
GCONUNUEM «wise iets ovis tandiaaats Meas 30-31 
continued, Pell’s equation .......... 34 
Partial. :c 5 irae steed ghennssase'ars 72-73 
Fredholm alternative ................ 94, 378 
Fredholm integral equation ......... 375-377 
PEQUCNGY) i: s4 cect hadissharsininen Ba seachdbin by 797 
Freésnellintegral: «..:cis.ce5cines eae savinne ser 476 
Fresnel transform ..............000e eee 516 
FroveniUS NOM caw sudcadcdodeneeaaseuss 92 
Frobenius—Perron theorem .............. 102 
Frocht’s theoren) .<..c5 ccaccacaceceda eens 167 
PPUSEUIN, oy he 8 eerste nan Wa tae Mewes 266 
POM aN Ks esis WN GRA whet acealedobe 93 
functions 
algebraic, series for ................ 59 
ANALG 3.9 catia  oeRaSS ree wre a 104, 406 
asymptotic .... see asymptotic function 
DICCHVE 2 teat caine ued Been! 394 
DOUNGE” a..5.2 shoe ees bic sien bigness y 406 
COMPONENE «ici... hada eeawk eave 267 
COMPOSILION, eo. 5 sndisnen vsleaene ais 394 
continuity of in R ................ 398 
Contraction OF 0.4.6 poe cis ease oe ase 398 
convergence of a sequence of ...... 398 
dECISION 2 csocadaadaniaewtewanasaee 784 
Dirac delta .... 5 see Dirac delta function 
GONNA 6h) ian seas eaew ete a 394 
doubly periodic: .vcsisccnctaaeweea 474 
MUMS «sr Medes neay sieivot mania tne eee ted 406 
equicontinuity of ...............2. 398 
CQUIVALENE 5 aci.sts. sevens eciele/ect ig 401 
Euler totient.<..66 65.0 ceeeed adenine zl 
exponeritiall ss.j¢ccas leeds 15, 59 
SSNSTALZED his ces cs ee oreSeseyncenes 403 
generating .... see generating functions 
GIEN'SiA.2 as cccrtande Seseed recente 358 
Heaviside ......5 see Heaviside function 
Hyperbole secsc scene reine diss 61, 62 
Hy PeroCOMEtIe sf s2 sick Maawndes cece 52 
INJECUVE 5.2 Sein Siaedehegs aeees sees 394 
MIVETSE sa dead anueadae hin 61, 62, 394 
TiC GCNdIC ss. 0 yin woh oe 484, 489 
HIME sca ax de nchindoae Sadmeoniaeann 398 
Lop arith Me” 2 i.5.2/s sss thea s a eaten 59 
LOSS pias vis ead eure ga aa walaa Tate's We 783 
MAPPINGS: é sewisesnemawaneetacoker 410 
WMARUM A) sone cose cs sa ogous eens aos 281 
MEASUTADIE? i :.bs.2ticdvrts chdahanwe 401 
1110011000: eee enor ae ree 281 


MODUS. nce sc ced eaweearnnenees 21,51 


INDEX 


functions (continued) 


of a complex variable ............. 406 
OULG: vsivenessineeretweawes see esas 394 
opportunity loss ..............00.. 784 
PETIOIC. 1 2.25.6) ae hat tk Vind ad 54, 57 
TANGO sce nsiehonr eaarearaeeeecuds 394 
POSTE. coisacuvuesteriaeneetaakernt 784 
representation as continued fraction . 31 
ISK: eGautw stoke atiind ane onoiereaga 784 
signum ........... see signum function 
SIMPIS b.2 pnbcuawkordantdaanbueys 410 
SUNJECHIVE ss ss ciriawhediaioa 394 
transformations .................. 410 
trigonometric ................6. 60, 61 
LY POS Sidi Saran dee. pheanadaateanane 393 
uniformly continuous ............. 398 
UNIVAlENE cd: vsarhieeeie Mewes bie oe 394 
WAVE Sacenitiatoezagret Resens aera seeaa 489 
fundamental 
differential .....cscces.cnosenegetaeeas 271 
GOMAINS 3 :e'ss canine vaeedeaae resents 204 
1OED Naas ncanalenaatea’ 270, 271, 274 
IMEUIG:. rosci ds vaacesnascosms sneavasinre’s 271, 274 
system, difference equations ....... 185 
theorem 
of Abelian groups ............. 118 
OF AGED cis corecs es arere vdning aieie 70 
Of calculus 2. cc. csarcienes 279, 292 
of surface theory .............. 273 
PUZZY 1OBIC® shen ntean-a dune ois awnactitiie bie 764 
(GAM OO) g.cocs si apse dain greed: s am aciaiscge tees ee bse 3 
Galois eld iosc:cheedwccews ese eans aaeedes 117 
gambler’s ruin ...................0.000. 550 
game 
COIS cavieccsunpexeeanneasess 546, 548 
CHESS) Shit cscdela ited pated. s daa nausea 22 
ICS ind Silteetat race ease mses 549, 551 
PO! a Accawdmadnatinedivanne Otters oie 22 
IAUTIK: 6,6 celasals ands Bale Sree ede acalonis 801 
prisoners’ dilemma ............... 756 
HHEOLY: fonangadnawnon dacs 754-7157 
gamma 
FUNCHON: 2.5.50 Sink Ghia 478-480 
probability distribution ............ 558 
PAUSES MVANANCE: sas. ss seritwiereoeddnsnads 709 
Gauss 
—Hermite quadrature .............. 672 
—Laguerre quadrature ............. 672 
—Legendre double integral ......... 675 
—Legendre quadrature ............. 672 
—Mainardi—Codazzi equations ..... 293 
CQUALONS. 46s co yan ce gene dake 273 
FOPMUNAS: iso ccsia dares oaiaie one's 227, 301 


googol 833 
Gauss (continued) 
hypergeometric function .......... 481 
IAW! csegeieiesoheaewietonnaeiie sma 708 
law of quadratic reciprocity ......... 29 
LOSE bios st OA so vacin ae Bhoedan tadvenirasd 49 
HHEOPEM 2: 6.<24.0sadnrka nag Raed es 46 
theorema egregium ............... 213 
Gaussian 
Curvature .......... ccc eee 271, 274 
double integral ................... 675 
CMMINALON occ ccs daeseeas 84, 659 
MEE SOLS: 3 sch aoa detsacenathey acaseoteatred ates 114 
probability distribution ............ 309 
quadrature: ....5c.0 ce eesecaens 670-674 
random variable ....: see normal random 
variable 
gender distribution. b.2s3 desecdudiovwis cece 550 
general triangles: sc. ciscciecass tans 433 
generalized 
FUNCHONS: 5.:0,5:6h ee asic beth eaiseatan eds 403 
INVETSES: dixon decdsrcceic sas adeele eases oF 
Riemann—Lebesgue lemma ........ 497 
generating 


function ...17, 18, 36, 46, 53, 142, 145, 
167, 187, 488, 538 


MAUR sestide ccs arnias. naan wont 731 
Polynomial: - cccsnancdous sores tens 731 
random variables ................. 571 
generating function 
EXAMPIES: sstairdis va rewinsre parcmedaes 148 
PENELALOL sive cinrecarsens deeded ne adies 265 
NOOHNGAL eiadetew es ViGbwsd tudes 570 
genetic algorithms ..................... 779 
DENCH CS sis chins dha hme eaiad aan eae mataaeedens 716 
PeCNUS OF. A SAP ce hos vce egararienomnreds 155 
PCOMESIC si5:5:5:4.ssacarageavalsen sara ieats 271, 381 
CUI VAUUIE irs ad sac ost namie ia ote o 271 
geometric 
arithmetic mean ...............-04- 48 
MNGAN 44 dapas-adiachveaes A avaxeuaaveceee 70, 581 
MUNI CHEY 9.0 6 grave vested din otkle wed 102 
probability distribution ............ 554 
probability problems .............. 543 
PLOSTESSION, $05 u:4's sah onsen gnaree ss 69 
SELES su deccnecdesnedeaswns vans 4, 52 
PCOMCWY ssc ceeiscivedeieweeee sadades 193 
Cifferential. sii cs.as td sed nee stary tes 267 
TCS es, oh See eS eae La hae 176 
Gerschgorin circle theorem ............. 102 
GIVENS TOLALON: 4:65 56 velesd sania masts, ccouiion s 86 
glide-reflection .................... 200, 252 
Golay COde i040 ations seen sess 731, 732 
Goldbach conjecture ................0.00. 37 
POldeMTAWO 08 Ladaaneekas deeds deve wes 16 
relation to Fibonacci numbers ....... 18 


BOOBOL sesind Shure ede nd ned naiibawe Pawansow sew 6 


834 googolplex 


POOPOIPIER, 5. Movuidcncne exaen wea eues 6, 64 
STA, OPSLAllON” 6.656 3.4 savage ee dew aas 388 
TAME soinidd wendiviaawmetwsome sea coaaeec 193 
STAMIENE «3c sasieea hina 283, 385, 388, 666 
PATS) hese sate Sataoe hatch. dane scam spasseoere hanes 799 
PTAPDS oon vs vee essugieck eve ce nnsces 151-171 
ACVCHC: a cciskawvesabesacesagcaess 152 
algebraic methods ................ 166 
ALDOTICILY ais sc assweaie eases 152, 163 
automorphism ..............- 152, 167 
bipartite: .c.cgcdtivens shit 157, 160, 776 
blOCK issn devka cag hhead aaa teaehs 152 
CONE his Sui dagecheceeneeesaoaues 153 
characteristic polynomial ..... 153, 157 
Chromatic index. v.00 3.0 o28 sun ees 153 
chromatic number ........... 153, 164 
chromatic polynomial ........ 153, 164 
CUCU Gacaisuesa denies 153, 160 
ChQUE iis ate wate eh teeed 153 
COLLIN 4.5 pac vewenanns 153, 137, 163 
complement 2 coc scscnser dev eceiens 153 
complete: ci. cccciie ses 153, 160, 161 
CONUNCHON: epics seidnc ena wena cde 159 
connected) .esissuscwasewewwes wars 133 
CONMECHVILY 6 Sod ce Gus,dkewanadony 153 
CUD Gs. livegar cash vous teaanteose darth 160 
CYCLE si arvcciorajaincondiacaoaieiee glare sanaiacemiers 160 
degree sequence ............. 154, 166 
CIAMEIEE so5:7oonisc patepedindaen utlencaans 154 
GIRECLE 25. cap sani ntnm oercevee 154 
GiStaNee vcccdacesesewaxs daw ee 154, 165 
LAWNS sais. cccncides teed orale de 88 165 
COSC erdias detract eave sive Midd 151 
edge chromatic number ........... 164 
edge difference operation ......... 159 
edge sum operation ............... 159 
eigenvalues in spectrum ........... 166 
embedding: iiscciccanaviecss oe 155, 165 
CMP soo siewiciesicatinsecteseema vin 160 
SHUMETAUON yc seca des eraserona sas 167 
Bulevian .cccacecntvnas casces 155, 162 
Fary-embedding «cscs ewes ees nee 165 
four-color theorem ........... 163, 166 
PENCLA. a 50 cea dawlewea taupe nsauwass 155 
SCNUS Gacgsowreaea bide sac veu ae 155 
Hamiltonian ............ 155, 160, 162 
handshaking lemma .............. 166 
INLETSECHON: 6 iia shy aad eee Aes 161 
INtEHVal st. 4 ohn hae eaederer nears 161 
ISOMOMPMISM 6g o.055:6 dss ei0's ea ness « 156 
isomorphism classes ......... 168, 169 
KnGS6P ccisccda cages cet sanweniene 160 
KG6nig’s theorem ................. 169 
abeled: 4. sete nud satensares es 156, 168 
Ladd OR iscsesnwsetthsattvets sh testetataeiies 160 


INDEX 

graphs (continued) 
IMALCHIN GE 85: .sna.6 suard nie agenbeceescnsnasd 169 
ICM SPACE’ su Lie csigdainewtedocaen 165 
IMIOORE 5 Sasso Sdtacsleoed oad dete aes 165 
IMU SLAP Mc: atssr pce lece Nant us tncacele sade 152 
MUltIpPArtites:... cs Veena eee lee Demers 161 
MOON: 25.05.4o4 cunts dasaewe res 151 
Odd aia tnatenn than cama 160 
OPSlallON a isetciepaiecaenma setae 159 
COMPOSITION 5... aes eiev au vnie 159 
CARS SUM sce bee erates gakiasess 159 
OUD iat teeg esvensieata ta tia neta 159 
POWEE: sssisiesigee ed cadiendgeweasis 159 
PLOMUCE osc cisic cert onciceiin oa geidions 159 
MTOM 5:2 Ghavgiaiire cresnuctes ce macoeeasansass 159 
OLIEE 5 pays ana osredonaseatssacunacsoavers 157 
PANONS: Js ude enksiceie shies 163 
PAU can Steers tnd tah 157, 160, 162 
Petlect su tetigaiet ceMisha we tased 13¥ 
Petersen icant cdaes sais oo 4s eines 160 
PlANar oii iad ee eves eden aaaee 157, 163 
pseudograph .................000. 152 
POGULAL:. 1. 2xicts.g stares vas spine sete 157 
SIMPLE 3 sicsdc ces iagw eeu sa ume van. 152 
Stall oe A cdwcccathcas cause eevee 169 
SQUALS! sha cnstcstesrantn sd cnaraie tones ater tex 159 
SAE fe acneuie cages toate teeewe eee 160 
SUBSTAPN sieges wade oe cours wees 158 
SYMMECMIC A ichacsennetaosontenss 158 
tHIGKNIESS: -s.5c:pcssa-sud av heeas tee es 165 
{at Boe atotdn ame sautsnet sideman she 158 
TEES area wcdesitswineonme nes 163, see trees 
Unlabeled: \s.2ccuts iy cveanawedwetan 156 
VETEKS: 2 ive eae 151, 156, 158, 163, 166 
Walk csicosias vaendteameasninels 158, 162 
PLAVILY.- wenite%s,ccninpetainr acy stances oarapae ans 696, 797 
Giay COde: iin pst hiantac Aaegaaaebtcs 178 

greatest 

common divisor .............. 35, 739 
lower bound of a subset ........... 395 
Greek alphabet 22.0.0... cso hesicseewsces 803 
Greek letters: iis cnchatns Seen edaarnepeiane’s 749 
Green’s function .............. 358, 359, 365 
Green's theorem 45: ssscegecars hace Poaceae 300, 301 
Gregory's formula: «.2cachesobes waidesawers 670 
GiepOry’S SENS ia caienodi-s ov otilemewa esses 20 
grouping terms, ways to ..............4. 144 
PTOUPS scare nyark a sobeia See ees tate tee 106, 108 
ADE at aitannade damage canes 21, 120 
BOGHIVE cistst tnsosuaeasadeeg nko 106 
alternating ................4. 108, 109 
automorphism ..............- 152, 167 
Dee jos atsczaha setae ghanntoras sine waccinandea oe 112 
Characters’ 4 yds add iowncavionan iad 128 
classification ................ 107, 202 
crystallographic .................. 202 


INDEX 


groups (continued) 


CYCHO: sc5 cae sicyecraus 107, 109, 121-124 
dihedral). iiiesc0is oven as 108, 109, 125 
GITECE PLOGUCE sive a destaieteay aces 108 
PAGCOR Oca die rice BAl ad ea Neeeaee 107 
TACUS) «4a ones ataccacietgleerede ooh eintaet 107 
fundamental theorem ............. 118 
homomorphism ................-. 118 
AGCHINLY? sc hee wenatelatiesae naan 109 
ICN Yi se. sid setenoaweuonee wateus 743 
isomorphism ...................0. 118 
TAG? os. s pst trae casa boagh scevdedabiesa ans 107, 360 
matrix representation ............. 108 
multiplicative 2... ....00cceveeeees 106 
non-isomorphic ..............+2005 21 
MUMDEL gcc con pene amedwaseaeioad on 119 
ONE PArAMeter 3. csivse vee weie views ve 360 
0 14 (=) f: a ea a re 21 
permutation ................. 108, 109 
PLOGUCE «5.600554 aidnslia mas eewes 108, 118 
QUALEINION: *s.65,66 0 soos eeener donne 125 
QUOMENC ec cscuresacineateatelcneans 107 
SUMPIE: aicisscncsiise sig'sne acta 21, 107, 120 
Small OTdeF os. sacacsexews coda aes 121 
Solvable s.0.sc.ucciekneneearous ous 107 
SYMMOUWIC: chceaalgeay esas 108, 109 
SYMIMECWIES | 5.5 sre sr erwiecn ders ay pob-clsie ae 202 
Wallpaper .:.aciscnii vn ee aiee sae aa eae 202 
Gudermaniiati «5.056 se. den avew ens 449, 450 
Haar wavelet): si06 sacks asus bueecied chav ace 789 
Hadamard matrix .................05 87, 180 
half angle formulas ............ 227, 430, 436 
half side formula 3 .i.0s5.0c4.0% eee ia’ gas 227 
Halls (hOOPeM csc vecuae des diwsndaweawas 169 
Hamilton equation esis cs.cisiee seeseieeacey ee 701 
Hamilton-Jacobi equation .............. 374 
Hamiltonian: accra saves iaeuaadees 701, 735 
CYCIE «f55 555.2 Sue ean aeatediee 155, 160 
PTAPD airs s.dscdaecnawnane 155, 160, 162 
PAUL e:2iscsé. opin aohG oes dy ea eartindciias 155 
Hamming 
DOUNE veacesoues oeeveeeeoune 731, 733 
CODE: fctiaesuadiiaehaianeic 731, 732 
GISIANCS 45S iio eda ea aesey exe 730 
handshaking lemma .................... 166 
Hankel function ...................00005 460 
Hankel transform ............. 493, 503, 522 
Hard y'S theorem: :5:4:09i!inssaaccemes aahgues 510 
harmonic 
WIGAN echvcavicsctacta crevices sede 70, 581 
WOMNDENS 666 can eared aun edge deacers 47 
SETIES) dais ccrautagtalerandiiln nie aunts mae hunten 47 
Hartley transform .................. 493, 504 


Hasse diagram (posets) ................. 138 


Huffman code, English text 835 


Havel-Hakimi theorem ................. 166 
harvard TAS ou sn cawcesnavaasansansaned’s 578 
heat Kegsdiccantan megs yeaa Sess tiew ve 800 
CQUANOM 3.5 vad eaintnee anew nem scion 374 
partial differential equation ........ 687 
Heaviside function ................. 303, 404 
Heawood map coloring theorem ......... 165 
Heine—Borel theorem ..................% 397 
Heisenberg uncertainty principle ......... ra ie 
helix, cieulal ..45.sexseaceacnsagnsenens 269 
Helmholtz equation ........... 367, 374, 389 
NEPLAC ON sso sew yairecs aa ad tadcteaeos i oe 219 
Hermite 
MterpolatioNn....i5.< sieve vs eare ao see dows 654 
polynomials ............. 53, 451, 671 
Hermitian 
CONUSALE so. scdhadcanagwdeneenine 84 
FOCM 6:3 Sadaysniinse hve s ena aye vee bee 84 
KEPT! sina 3 Sates ect) sea tet Say sen 375 
MAI pischentatanreantienaanw aging ais 85 
Heron’s formula .................-. 214, 434 
HESSIAN. i. ee heeaG aoe ba aaa ao es 285 
Heat's metiod coca es acai eva sveees 682 
heuristic search $..:i0ccoscia see aedacvia sored TTT 
hexadecimal j...cs.dc0ieai desea pastas sass 12 
add, subtract, multiply ............. bss 
NOLAHON: 4 ss 40 d.acsdasnagnandso du sar 10 
SCHIE, 5 cnpvaciaorieneeeeasuenbeoues 13 
NEXAPONS- yccacsn neue angina eos dale 219 
Hilbert 
—Schmidt kernel .................. 375 
—Schmidt norm ...............2.085 92 
POU seco tise 5h Bae G cata ha ence nee 95 
SPACE gs 5.0 area neeeusicss abbey leas 401 
transform ............... 493, 505, 523 
HIStOSTAM: siersiscccriatesardiannsiadnaussietace alos 580 
hitior miss Method. . w::s:56 i500 ve wa ase s 676 
Holder inequality .............. 48, 295, 400 
holomorphic function ................... 406 
homeomorphic graph .................2. 135 
homogeneity, scalar .................... 399 
homogeneous 
coordinates ........ 198, 201, 251, 255 
SQUALIONS: wij cigs oer cae ares os 186, 356 
integral equation ................. 3%5 
0) [1h (0) | ee 350,351 
HOMOMOCPHISM v.65. 26 sss eda os ewes 118 
homothety j20scs cases vows gas 207, 255 
MONOLS:-.Paninvtcarsleceracte aan ieathiaan aieneeace 548 
Hooke’s law .oc.ccccsoesaveaseonse 696, 722 
VPHopital’s Tle oi. 6 ceive ceween 282, 465 
Horner’s method ................0000005 650 
horsepower-hours ...................05. 800 
Householder method .................4. 662 
Householder transformation .............. 87 
Huffman code, English text ............. 733 


836 human body 


human body »6 sds ewancade dw ovieden be 713 
Hurwite Equation 35. sn.eee teas vadeutewes 32 
hypetbola:iatotevesdidevses kee siesdelns 229 
CONJUBALS: aio Pensa de ta dees 235 
PIOPCTHES si teste edi Gane weeds 235 
FOCHANGUNAT ge sagacinc ede dems eases 231 
hyperbolic 
CQUAUOM) -s/crtcusiasaerauioreenclansen 362 
functions ........ 61, 62, 443, 447, 450 
partial differential equation ........ 685 
POM: predicts dena haraeaceamcaee aa 271 
hyperexponential service time ........... 562 
hypergeometric 
CQUALON: 4 dvd daedamidoWivesiaemy on 361 
TUPCUON cccg cuca axeoksaakerea 52, 481 
functions, in solution of polynomials 73 
probability distribution ............ 554 
SOMES! fori cusstschitnnt a seubetedh-atenopeans hone 52 
hypotenuse, of a right triangle ........... 213 
HY POMESiS. 0:6 sic saids sceedederegesaenss 762 
AMSMALVE: 4.65 ae onnerrcsesedeses 582 
CONUNMUUM 63256534! sn shaniawinaenarenae 137 
MUU sada nano idee eres macnsia ae Seana ekes 582 
Ri€MANN. 645 Sciex ce eausewe esas 20 
TSE sae dea ued cee ened neades ss 595, 606 
ICOSAHEMIFON, 545.5 sed. sarscd areas aceagrewene 262, 264 
ACA si chisiars Ss Sraghs accstiansanhavand Seda siareibed bee 113 
idempotent lAWS’ Sar widcawelce meted seis 762 
idempotent matrix ................ 85, 96-99 
WOCTUITIES, da cisd ss dd a eeee 429, 442 
AIGEDTAIC: vo s.curtarteragersaee ones Tl 
Bianchi is s.c.0picu sincere sins earnmrnnnr aces 383 
CYCHCAl rsannaseauGawegaiianeew’s 383 
INAEXICY CHUNG ic usixeaasewunaetss 1% 
Wdex doubling sisi ces csswsesoe 115 
WACOM, 9:5 rcc0 dodquvehac ete dsneate mwdawenies 65 
PatseVvall Siccesicuicssnatavevinetincagarvieass 402 
Pfaff-Saalschutz .................. 51 
RICGL s.iccdinddedsaigoeasa aneigekecy 383 
Rogers-Ramanujan ................ 65 
triple Product: 5... dade nachesaee 4 65 
IGEN” ji ntctiedagd seeen tang hacen das 24 
SISMENE ap ined usevnteas Bree ecm eden’ 106 
BTOUP) weil oh tease eto ntd 109 
MAHAR: 2505)3.Shic wales eae ba meslaagedends 84 
if and only if, in propositional calculus ...761 
MEE Sega's prnace sarees genase eas see arenes 761 
il-conditioned .iusc.ses sc caaaw ens cone 94, 97 
IUMave/ OF a Sets cic tencsdasweseuosevemesse 394 
imaginary 
CMP Se rhe a5. fs asrid peed sa dinsca 232 
part of complex number ........... 405 
WME cscs. tsraning rahe o habe eateries 405 


IMPEdANCE 5.5.05: sas dae Sasa sharesiarnare tea 710 


INDEX 
implication, transitivity of ............... 762 
implicit integration methods ............. 683 
UMpPHCt MEO ow scisaitesieksseedenase sb. 683 
TM PHES ySesnaiith Ss, gates carb eacaredvekmte tees 761 
impulse function ..................0.00. 403 
incidence 
STAPH o. vieasvswes thw waeasiew womens 155 
MAPPING ss servieedasieeloc eon 151,152 
GOA csi e st idwnadexaisewena 156, 172 
OF VETICES! oad ce here va eacwmeenee 155 
SUCHE sss si hin fA acesdin biota ss veue nt 172 
inclusion rule for set properties .......... 139 
incomplete block design ................ 173 
inconsistent system ..................0005 94 
MNGSANIUE: 30s appiaaesaowse amen eaGows 382 
indefinite integrals, table ........... 305-342 
INGEPCHAENCE: ss. asivanesasneswieshivbien 3 623 
independence number of a graph ........ 156 
independent events ..................... 536 
independent Sel a..cc varsavsdaace cess 156, 163 
index, chromatic ..........0csceeeeennes 153 
indicatrix, Dupin’s .400i008 cenieaie eens 270 
WNGICES os is,scsiatsiane ca arnnpauideS Gea inalawiacealerecs 128 
contravariant .6..0esceegses seeies 379 
COVANIANE™ wih wcinace geswecewens ewe aT 
lowering, raising ................. 382 
TAISHIG: wis evo sndigiten vareuniaiaina hes wood mde 382 
induced subgraph ..................000. 158 
TNGUCCOR sp rs-aaessivecsrs Gate sa action euiibeuntacerase marx 710 
IMEQUAIIES 5.5 cusses bisa ne ances Bi Os 295, 400 
arithmetic mean—geometric mean 5, 48, 
70, 400 
Bessel iyiisdcaeaatnenartnntane sugtacwiten 401 
Bienaymé—Chebyshev ............ 542 
Carlemat:isciccesiaeeiheaeguer vas 400 
CaMChyy sainatant aca atate a eiicenareae eed 407 
Cauchy—Schwartz ............ 401, 542 
Chebyshey iiss teiewetcuseaccure 542 
FISHE?  ssuvec even peanexansc en 172, 1'73 
1 (0) (0-1 ae 48, 295, 400 
JENSEN. ¢ siieo ind Sends rtevs'son mies 76, 400, 542 
Kantorovich: j:4.3.40 40 seecnccs anaes 48 
Kolmogoroy 3:65 tennegdeeatemeaieas 542 
MAPK OW 23556 b.co4oe db aracsontosnaede cuca 542 
Minkowski .............. 48, 295, 401 
probabilistic: 5.5% ceess.adiewns ieee 542 
real numbers, properties ........... 395 
ScHwarte i.) cueagsaieden 48, 295, 401 
trian Ge x..5c7han ate Sever ar 79, 396, 399 
WSUS cnn cacuuaens wautadenaies ved 102, 766 
inference, TWO cckcasiascesacansnaewers 762 
infinite 
ONOER: 3S cou roma omaaietanewoe soe 107 
PLOGUCIS! ia scch ates chat es dota e Rasalan 65 
SCHES hat Histo uelpiadns vaemaanys 59, 65 
SES xs e sane ud aun Pdaea meen ees 137 


INDEX 


infinitesimal generator .................. 360 
INHMIGY acu: Pep avs hi. oneareaneans haat 9 
information theory s..60.6.6s.6.0 cence 729 
MMHAL TAY gest nous Hetoeice enka edad 197, 250 
initial value problem ...... 184, 375, 681, 684 
injective function ...................00. 394 
inner product ..............- 79, 80, 382, 719 
inscribed circle ........0.50008 213, 218, 433 
INCE REL 9. Sct aWianteenawals ak aia oun Sant 9, 28 
ASEDLAIC sss ced atest enn een ss 116 
programming .................00% 774 
SEQUENCES: yess asitingeacotins 21-22, 805 
SEHES: Sav asa hamachi oeednie see bGen 21 
WLS LOTS: s5ia/as de ardirwsacetalbnk BEdiore ings wa gener 28 
integral 
CONLOUB  scsssrageuy dans danaconra octets a 302 
CONVELSENCE: ais ceodewd wee ees eae 49 
OTHMAN 66.5.9 ca ein ee pee Sialic ners 113,135 
GOUDIES sone ites edn ats 293 
CQUALONS ic nie van eas veuddereeeae 375 
formula, Cauchy ................. 410 
fraGtall $3.4 is sasaaeigeawalewneeaeews 25 
APTS saceist orice tcassersuda sin lente dmaia atone 300 
repeated! is.wcsesia see veeeta see sen 510 
SUPACE: Sees beets cee ntee eee 300 
CADIS petseinh desde atntedey eedtoners 304-349 
LOSE is ccccremnaeanibin eine med mndms concen 49 
theorem, Cauchy ................. 410 
transforms 64... 0<4.ess< 493, 494, 516 
integrating factors ................0.000. 357 
WNLS SALON | 4st arouse Shawn sind & oa oie 291 
by parts: csseeetsiovaassien 298,299, 357 
numerical «504 css sees see quadrature 
of power series ................ 48, 50 
interatrival HME x ..5 co ee ace ede e enn 562 
INMLSICE DE. 4. cacdnsss suatat ada iptmorein toes Dot 
WOLHIOSY: hin ecadna eeadaanieadaeew eeeas 746, 753 
compound .............. 746, 752, 753 
SIMPIC sansa ncdanbeeeaeueneuiens 746 
interior point method ................... 772 
intermediate value theorem ............. 279 
interpolating polynomial ........... 651, 654 
interpolation 
Hemme o2ch.iss kavashant phaeamektes 654 
INVEISE cine daa eeeNSeeaagateotes 654 
Lagrange ine. eneite aaktie wie tance 651 
OF APUNCHON 266 5c Fie ead cadens res 651 
interquartile range ..................000. 582 
ILETSECHON. ch aieanrgatiag vas adeebanes rd 257 
BLADE wate. s35;< apse scateca ae tnantecs nace 161 
Of elements 5.0.5 seco case esaie 396 
interval 
ANALYSIS, sisssdaseaxdokecdeueear ed 24 
BLAH icgshssaahadiotsbsructratavetendue aia 161 
of convergence ................00085 50 
CODD sesriae ode sized sng enna ae sees 24 


Kepler equation 837 
TNWAHANE o.0csea at eaeraamedheavad ees 268, 378 
CULVAUIE x iaid Momscoaeneding dea 384 
STAPH i wrieacackovds dude eowiebe ss 131 
F111 (2) as com er ar eR es eT 106 
circular functions ................. 441 
FUNCHON < ode wn snecdanadodwences 394 
Generalized)... scdawessvsasidennda ae oF 
hyperbolic functions .......... 62, 447 
iMAge; OF ASE ci siswsanaaivacesavns 394 
Interpolation’ sesiviewvcwreccnae seer 654 
LLY: BC en ee ROC ere ee 83 
power Method v.65 ck ccesa rans sein 661 
transform method ................ a7! 
trigonometric functions ............ 61 
inversion 
formula . ..497, 500, 504, 506, 511, 514 
Of POWEF SELES a siccsinewctwdengncene 50 
HNEOREMIG gai pi 0 CMe thie 498 
inversive, congruential generator ......... | 
irreducible 
elEMENE 4. icruenssanmgetnctoenes 113 
polynomials ............. 21, 114. 177 
WrOtAuOMAll 5.45 sda gwdases asduies Sanam cha 283 
isolated singularity 2: su scs.uso.acewaea 408 
ISOMEITIES) 3.5 dace be wees dae wes coos 200, 252 
isomorphism of a graph ........ 156, 169, 170 
isomorphism of a group ..............-- 118 
WSOSceles tHAN GIS... cocci died een eda 213 
iteration, fixed-point ............... 647, 648 
Jacobi 
polynomials ............ 451, 454, 671 
symbol (quadratic residue) ......... 28 
triple product identity .............. 65 
JACOWIAN:<adnve hesdagaswadks eeeoas 285, 404 
elliptic functions: is. sesetsewsiennded 473 
WGK oa irhcwtanas 378, 665 
VANCE 6 6 ick Ges Ged ONS A teed aceahenin a hteace xii 
Jensen’s inequality ............. 76, 400, 542 
join, operation on graphs ................ 159 
JOIMBAENSHY: iss vctsieailapsawwesiowas as 539 
JOMEMOMENS..o:occsccmparnervaesaaaaeans 540 
jointly sufficient statistics ............... 584 
Jordan DIGEKS. scssasis test xsogvewsawewes 100 
JOUNES ss. ttt aneceacizemacassaatoounvincy Wheaties 800 
DOliaSEC ss cs iutds earccaedaeitis entre eaters end 741 
jump discontinuities ..................0.. 54 
Kalan filet i0ijc jaan ce cats easy actit es 787 
Kantorovich inequality .................. 48 
Karmarkar’s method .................+05 TZ 
Kent psec ganchadeas arn cho Wists wer eeanae wend xii 


835 Kepler laws 


Kepler laws: i.cj23sciuducis Sacer tarcinantea se 692 
kernel of a group homomorphism ........ 118 
kernel of an integral equation ............ 375 
Ketch athe tata aamatnna bet ieicdes 718 
key ‘exchanges iis. nu5 woudobe wenden TAS 
KiDID YC! 2 inde bauet etna Gores sameudend 6 
Kil OSTaMS: syis ot iavaketiieehationtahs 794, 799 
KIOMEETS isiciasawieaw cas an edwswnes 799 
Kilowatt. os sciwcasnseagionet ova se wanda daes 800 
Kirchhoff matrix-tree theorem ........... 163 
Rilein Bote: 4..csccausviveacosescne eats be 204 
Kinleser Srapht «iscsi cetiese tes oh accsnectnnekes 160 
MT OUS a5. dos. ts hier d Bvathovaids On eornendcelesee eed 22,757 
Koch snowflake ...........0.0--0eeeeeee 247 
Kolmogorov equation .................. 359 
Kolmogorov inequality ................. 542 
Kolmogorov-Smirnov ............- 604, 643 
Korteweg de Vries equation ............. 374 
Kronecker 
Celta, .nccwamedennatetiews atatemsnaeian 378 
PTOMUCE s...5,0,0 508 ie esas eeostewan ears 104 
SUID Fy55, nictorsin apa areatenaganleay ongaseents 103 
Kuratowski’s theorem (graphs) .......... 166 
KUHOSIS: since ngivecewewedeunadaaeeesers 537 
VHGpital’s: ule: ssi scascas as beee ee 282, 465 
labeled graph ...................0.0000. 156 
lagged-Fibonacci sequences ............. 570 
Lagrange 
QUAL ON 5 6585555 boy big Nb wee da ae 701 
ANterpPOlAatlON’ i. asioie is ees e dee vares 651 
MAUMPHELS: oc sasia nce saa nes nae edaes 281 
POMAMAED 5. 5.0:5.06 Vasionsdwnleawardaiass 50 
SOLES Mead iaiciansiuleaanasiaw adus 53 
theorem (sum of squares) ........... 35 
MA STAN BAN 55 becdisi-eseac vases banan ce omen Hee 701 
Laguerre polynomials ...... 53, 181, 452, 671 
Lahire’s:theorem::.500.0350i cae snes oaeencee 235 
Lame CQuations: a.:00 650 %in eae e ocinsae sien 386 
Lambert function .......... 00000006 145, 483 
Laplace 
development vhectgedeccdesesmesees 91 
EQuatON ca c-ocsneee 367, 372, 374, 389 
ANS STALL 2A dete Sadan gett 508 
MEO”. 5.45 edieriarinpdoawd.s celemeres 304 
partial differential equation ........ 686 
transform . .56, 357, 493, 508, 516, 525, 
563, 734 
CONVOLUTION 5..500c ose eee ces afl 
Laplacian..:.35 cssceeracenenses 367, 384, 389 
large numbers, arrow notation ............ 11 
Latin SQU are: os). nie vcin welneG tables easicing 179 
Latitude! .2i.c.0c.cneiecwaaeauninrenetoananes 796 
VattiCes :5:accredarnmed madara aie aataearsaars 759 


INDEX 
law 
PATAPOLS i.s disc tam rsrtn acicinh ag eanzecs 708 
ASSOCIALIVE oc cecea tiga eens owndes 762 
Biot-Savart ............0e cece eens 708 
cancellation ................. 107, 113 
CICUIAR cio. cA ake Aeas tae teniaettated 574 
COMMULALIVE....52.c%nedecavaheGiaeds 762 
CONMAPOSILIVE® 40.0 pci ie wee case 762 
COMO 66. c5:das senses anweeases 708 
De Morgan’s? s30.ess ses cesee seeiens 762 
GISHHDULIVE 65 bo 6i icc eden otaansoes 89 
GABE sce cela Sabeasndheateda anced ad ddloie 708 
TLOOKES: wxjecossietieie Seine eavetuees 696, 722 
IdEMPOLENE sc aye nada naurienewers 762 
Kepler .c'5.s hau davnndaaens saved aie 692 
Battle's 4 sis bass aareesnaceal see Little’s law 
INGEWION SS iclianeedan enehnewaee we 697 
Of COSINES: 6 scien 214, 226, 432, 434 
Of exponents: .5. ee we 69, 421 
OMINEMA: Sas tennan at aeeaneeton 102 
of quadratic reciprocity ............ 29 
of reliabilities .................0., ai? 
OF SMES aj casaa ve sae 214, 226, 432, 434 
OF ANSENIS ss wscnccancas ie kous 226, 434 
of the excluded middle ............ 762 
of unreliabilities .................. aT? 
least 
common multiple .................. 35 
MOTM SOlUMON cs.cc6 os deka wen vaase 94 
squares approximation ....96, 656, 737 
squares problem .............. OT, 738 
UPPEr DOUNE s.rbiiccsavakceensedenaers 395 
left 
cancellation law ................2. 107 
COSEL. 5 darsd haved Pica de eee acces a 107 
distributive law .................04 113 
divisor Of ZETO: iss. e-c0i8 avenue oe 113 
Mand Witt 5 2 acd a sina e iy sco g's eee wo 54 
handed) so ccussica yeienseeen sees et 269 
TUNING +35 44,8.5.4 vere dongnnsearaggeecemacia 494 
SHIME 5 iscsctd ana nidisstihe onan nae sae 182 
Legendre 
CQUALON, h.c.nairneagrr sie made aiaures 361 
HUNCHONG s .ccd eed anacns cannes 484, 489 
associated)... sca. stds oye dae eas 487 
polynomials ......... 53, 452, 486, 671 
POLAU OM a hiscvcs are scbis dv eben dna adaanciews 471 
BERISS, ais pid aihe iawn dug eed aeeoe Be 486 
symbol (quadratic residue) ......... 28 
MCCIDNIZ AUS scree ahah ase e casks sie ee 279 
lemma 
Burnside’s? sic s05055 Geen vas 110 
handshaking: ccgescwsd astewsucsncaadn die 166 
Riemann—Lebesgue ............... 497 
LOMB tN iid eidec areata Mean euaearacnions 794, 797 
AUC) dra hadichiolhcatetivad breannea tee 267, 294, 382 


INDEX 


[1E:BTOUDS fx ccanvat:saaauiocaseneenne 107, 360 
WM? sais essmstanials De Pye odaiwe pear mans 277 
CXAMPlES iss ges eawsiddwea see boxe 282 
inferior (liminf) .................. 397 
VeftHanid: 3369-5 niente sais Sait cae ene 54 
Of APUNCHON oa sdgonaeadcs ee veces 398 
Ola SEQUENCE: 04556 vanana eee oom aon 
of infinite SeTIeS. 5.6. 564 see crv ee wes 47 
POG a 56:a oases asane ese letgee sem aeees 396, 397 
FISHMAN ie cniouscusuee agewnets 54 
superior (limsup) ................. 397 
LESBecacnih serait ststysedrdead wremedens anne 49 
theOTEM pieces cnagsbubca mane eho 538 
Ne CONNSCHVILY. 6 s.ccscnodcaninndsscarsnns 155 
LinG Clement..'s:scAsex's usenet s8 as Mesto oe es 382 
linear 
algebla sieeccccgivdicesuesesetaees 83 
CHAPACIELS). Stivers. S.tct vos gat wna 128 
CODE: eerie siya Lawhesdina thane 730 
congruential generator ............ 568 
COMMECHON: 5.5.4 3.0 on egy ens ae aad sangre 380 
CONVELLZENCE. siscccseainaascamengn 3 646 
differential equations ......... 350, 356 
CQUALONS 165 Ge cutee 94, 95, 659, 738 
fractional transformation .......... 410 
independence, sequences .......... 185 
integral equation ................. 375 
INGECPOlALION sec sidin nc edie ecedeeens 655 
ORIG. ci Ast che nnaeaned gpaninetatdiniee 765 
MAPPINGS! 65 shone eon ian sence’ 96 
OPCLAlOr® | incsiscgincotomew ars 187, 718 
programming .. 755, 769, 771, 772, 774 
PESTESSION iia weae eaccaieu Sagal’ 609 
SPACES cg ccsiceecetduecvenesar sade 96 
Sila vised snedancdeamndunnhs teeters 246 
linear canonical transformation .......... 516 
RES ish ay oar daanedekeeaterkeias 209, 259 
ASVIMPLOUC waises evens ws oomewss 270 
DESH: sc cs unwciewe cee veoun oe 657 
combinatorial design ............. 172 
CHLCAL, oy. r4.date Aeetatenia ales engee 20 
INEST: .02G2.ci cee eee inan se dearera 300 
MAPPING 5.5: ss oacpvasawne sone sievewas an 410 
NOMA! 6s i.5:5a.52paewdaeayne saree ahen 271 
of curvature ...............0. 271, 274 
parallel ¢ cscasiven tee shicsans 211, 260 
perpendicular ................ 211, 260 
POTS 11 sc asyetea sak cease tase wach a si ben Ssane 543 
principal normal .................. 268 
SIOPEC! cis sissamnad queenes aise 209 
SEPALS eos apc vrses ote Sacra dees 6 209 
TANGENE Scsivicwscia tna oeas seas 268 
Liouville theorem ................. 406, 701 
Lipschitz function ...................00. 398 
LiSt OF MPUES has, ci sated cs cot ebeaadded 809 


list:of NotatiON: <..4...4%0i.c aes edsnaeases 811 





marginal distributions 839 

HS OF TELSCeNCeS: diy. erccsualanwen mained 805 
GETS as5:5.8 5 tener ei hpnonaa anes eanlaned 79 
Little's 1aW. ccccsvixieesd ewocvewonas 563, 564 
Lobatto quadrature ................ 670, 673 
Jocal: MINIMUM) 93.50 eee ace ha cae eat 8 666 
local property ..cciwacoacns ace vannderes 270 
local truncation error ................00- 681 
locally integrable ....................2. 494 
logarithmic 

functions ............ 59, 422, 447, 450 

INtS STAM sd Jed sie hvala ds be 491 

SPA oasis cate tea Waste ades seca Graces 246 
logarithms: 00.23 sie oteseeeeaaeca reer dasae 15 
JOBIC: cid. siicuisndi v-clausinn geais daSanecins dior 761 

TUZZY ri oincntae ond ise tp temaee heat 764 

linear temporal... 056 osi cecee ee eea es 765 

SYMDOMG ss ised, aatntioiegan wee sania 761 
logical implication ..................0.. 761 
logistic difference equation .... 190, 740, 742 
logistic equation .................0.000. 248 
logistic map (chaos) ............... 7A0, 742 
LONGUE: 5:6 sachiatat aes eateaaietaitecntas 796 
lOOps(Sraphhs)) is sics aca aise scie'eones Mead 152 
Lorentz transformation ................- 721 
Lorentzian manifold .................... 382 
loss fUNCHON 4.5 by.i2) div cks chyadn ada sais 783 
JOtELy. sci niesbaene Sas mdegepeacewes 552 
lower 

bandwidth «. pisccincssekenncme ieee gosntieeecs 85 

Bou 53:35 icdncd egewid aes 395, 592, 594 

COnwO! Litt Syscses aati adidas RF fe) 

triangular matrix ............... 85, 99 
lowering INdiGeS! 4.052 scccve eae evdoies 382 
Lucas—Lehmer primality test ............. 38 
TORE evn ioe See eeateiemeweseeenacante 224 
TURSEQUENICES gapuris cchanad hued nite dade 182 
MacLaurin Series: 3 cisy.cnrnaeueraecnee ees 50 
MAGIC SGUALES) oc cose ved nine dar anrwe’ 782 
MAGNUS iris oon aincamceyaeneesaa tarts 708 
Mahler measure of a polynomial .......... 76 
MAM dMsONAl 0s, nade weed cawesone vena ss 83 
MAJOR AXIS. 2 bveiagd ied sity ees aa de can ee oes 230 
Mandelbrot Set: ciis.cc gdp sas dn teak cae ees TAL 
MANMON 06d cecveecawsnaruaane ones 378, 382 

Hat's cere orieederteniortkaddteneres 384 
Mann 

—Whitney—Wilcoxon procedure ....591 

—Whitney—Wilcoxon test . 600, 601, 605 
mappings 

CONIA jy creed dates 410, 411 

of complex functions ............. 410 

TYPOS p.5¢pcieieticckdeeansasreesasa 393 
marginal distributions .................. 540 


840 Markov 
Markov 
Chalis 35-04. ciucnmeone chainevecdnas 565 
TNCQUALLY sass avowibs beldebidarntates s 542 
TMAUIER: dps os ecatehon s duke ans eben es 87 
marriage theorem ...................00. 169 
DIOSS ceived vdsinataneeeeaineeecen 794, 797, 800 
matched filtering ....................... 786 
matching (graphs) ................. 156, 169 
Mathieu equation ..................000. 361 
matrix 
AOAUIOM 2 22-5 deedrscesya-aewcatecsagrregears os 88 
ACJACCHCY: Soa stsacdal a letbui ate tes 152, 137 
ALSCDIA oss agivden earegolee cagvexmans 83 
AUSMENLE sc aec in sieia cain ge v6 8 wrevelans 659 
bandwidth 5 secon sewemwee's caw 85 
CHCUIANE 5 dccnenscscaee deds 86, 95, 153 
COLACIOE 2 oghencanexet kaw meee 91 
COMM 65.536 pape aerate don 84 
condition number .................. 95 
Cétivatives: 0c cis ciscis eens eee ans 284 
Gsterminant 4 cas deepens ssaees-en 90 
CASON c.c0s scaak ates pesciels stan eee 84 
CIGENVAES ok csa eve die ee ew eens 98 
ClEMONALY i ecsinscone dda ved goes 84 
EXPONENU ALS: sc5 uiousiguegware eae 95 
FACIOFED 3 ave eed ade cholate bed 99 
factorizatiOns: 2... 560066 rasecine snow oo 
PAMES: is ¥ sind oa daerdenaaesielawlnne 754, 801 
CONCAUNG Kc hone acon eras Fol 
PEOUP siiscoayeaitinGonhie sea rdyastioviateecos 108 
Hadamard, sindesasciviewsabiancs 87, 180 
HOrMNION. Loc cscs wdacnsweeeeees 84, 85 
Hessenberg oc. ccksanvicetew sae es 86 
PWIDG EE zakiidscaecds need ve phoned 05 
Householder” isc os ceed eee eemen ss 87 
idempotent ................. 85, 96-99 
AGGMUNLY? 5 5, seclstnd-docosana ts Wee Sera ke ee 84 
HACIdENGE 5.5 ccc cee sense oes 156, 172 
WIVEISE 0 ec deo cbuavewsacnwecedas 83, 97 
JACOBI cei iasadsectacea cia 378, 665 
Markov wig cnGeacnd chia d nededn das dan 87 
multiplication .................. 88, 89 
DUPOENY ip saucndonans oman das 85, 98 
MON=SINGUIAT iis eacvescane eaerdare ves 93 
MOMMA Fd Raxsuawewrsier weds coon 85 
MOLMS i 632 chin Gn aeed ones gavewe ea bnts of 
GVM MMe B82 cated se Sauternes tuceianeald 83 
orthogonal ................ 85, 95, 385 
parity Check: .0.c.snewsasentae as 731 
PELMAHENE os. 5:scsiaticae smpranaiesdors nares 91 
permutation ........... 85, 91, 99, 103 
Positive deANIte: icc ..checcsdowkowes s 101 
positive semi-definite ............. 101 
PLOJCCHON: 5.04 xsenhen sedans ac 85, 96 
pseudo-inverse ................. 94, 97 


pseudoOspectta occ .ccicisueee seis es 105 


INDEX 


matrix (continued) 


FONQOME 4 ue an iek ca diandaseaerena’ 574 
RONG vice Sak ORe wie RR eRaeees 611 
MECCA SUIAL a5 6.20 vessetuti ase ate tov sch eas 83 
MOR UL AR: 4h oicyssoa aes. biasrideg Neate wie doaninite 83 
representation .................... 126 
POUION: coca ccnsaaniacnas destin 85, 86 
TOW csv suena cing ome eaa nas beweagen 84 
SUM AT sos een aiecnrgs. dssietatedgoswassanans 662 
SUMMAMY cc. sae eoacueseaneees 96 
SID GUNA” ii d5 4 dca ses ce cee ade sss tenths 93 
skew symmetric .................4. 85 
SQUATS 425s Se caenr ako umesnenye ooaes 83 
SUDUMACHON jo. <iaraialans cies sine oa0h wiedadeunns 88 
SYMMEHic 0.56500. ese os 85, 663, 664 
MOSPIIA, ssssoa aos annaans one eaers 85 
| 2] 6 ee 91, 93 
URANSINON sigs juin dead cated 565, 730 
WATISPOSE): oi. setts San wate tenes 84 
triangular ..............0..05. 85, 664 
UPPCP ces cbaaeans ceaetiennndeawers 09 
tridiagonal ys si ise.s cae ses v's 85, 662 
MIMCATYS sachsitatahecacsentacae aageinn piesa vite cocoa 85 
Vandermonde ..............-000005 86 
TOO. cu wekounoie nn eeNeu cies Genny 83 
matrix-tree theorem, Kirchhoff .......... 163 
max-plus algebra ............0.0. 0c ee eee 26 
maximal 
chain in posets ................00. 138 
column pivoting .................. 660 
IGA © ose: cpsdic Fe lak Ride, bee wiaes pw a ees 113 
PIVOUNE: coerce paciiemivees amined se 660 
maximin strategy ....................0. 754 
maximum 
HOW? acti athie@ie a auce aia cam eens. i 
INGA SAMPIS’ 6 sis ise stearate’ are 587 
likelihood estimator .............. 583 
network flow ..............000e eee 770 
PEINCIPlE e. sedaoinet eens meee Fe) 
Maxwell’s equations ............... 708, 709 
IMDS, COE: dh sdiein28 aoaine Batre mewn ones tol 
MCA: @.docueanke sees ve adedaweneieheeas aor 
ALUAMEUG: 6.50 see etaded aa eG 70, 580 
confidence interval ...... 588, 590, 591 
curvature .............ccceeee 271, 274 
EViAHOD vei ece cde cee gis aydesees 581 
OSUMAION ch ys sa deena seesaw ee 585 
PEOMEWIC tied kaa devs Ste ease 70, 581 
aTMODIC coocesecscaadacaes vas 70, 581 
SQUATE CMOP sinasauadagnwesni sealed 401 
LOSE a sssirsne avsce!stanw comrade 595, 596, 598-600 
time between failures ............. 578 
THMMEM,. % seis see oe ene we wed wrens « 581 
value theorem ...............00005 279 
WEIS) sei dod nettle Gackt hey 581 
measurable functions, equivalence of ..... 401 


INDEX 


measure of a polynomial ................. 76 
MEAaSUTe OF A SEE 4 ciicaadswacrcssemere ae were 136 
MeCHANICS 4.5.2 44.052 scvewwetade sacblaw pas 2S 696 
CLASSICAL 05. se cotsscacére Bae Vea oa,bcbe acne 701 
MMHG oe bis sey dh cacti eb oem eace 712 
QUAINT 3 5 sheds isseonibes asaia Rees anavand fa) 
PELALIVISUIGC’ 5,6 Ghia and ociedmansear en FZ) 
SOHG  iscscass adie ok aaietntanie ethics 722 
SUAUSHICAl y canasnescadnlewusneaw eee 723 
median 
confidence interval ........... 589, 591 
Of trian gles ics dws dace 213 
PIOPEICY® shaped scien da Cad wacuae 5 
LOSE sidisndhe dna eiews 596, 597, 600, 601 
Mellin transform .............. 493, 512, 530 
Menelaus’s theorem ................-005 215 
Menger’s theorem 214. .s0citewligeides cates 162 
meromorphic invariance ................ 506 
Mersenne prime ....... see primes, Mersenne 
PME SM 5 Shion S.c na anidieve tena tenniae baleans 160, 681 
message, in codes .............0200e eee 731 
WMCUETS cis 5s sha hese ansitvaraie esvrarore miata care 794, 799 
method of moments ................0065 584 
methods. of proof suis. visocs vase seewiew ere 781 
metric 
COCMICIONTS :oi.s.2.eseewdurey aeddeegnces 388 
SPACE nceddesacsaaees 79, 165, 396, 397 
TENSOR Wave cveo uancledeoweds 368, 382 
1011 ae eS 794, 799 
MAA POING. 6:5 0.guaine dove Hess waa ar aaeread acs 210 
MICO veuncivenwdcwuxdueeten geen 682 
PUIG 2a sexcdinmentheskdadawees wes 669 
PMGLAN GS the eis Atak a, ehecac 581 
MIE-STD=191%6: cidcsiinecxeas ccs caaer bas 626 
MNUMETS: «3 sends oak cad tadarnaraiee rds vase 799 
million, defined ocicccacees cease eve ncees 6 
IMIG PU os io2e5s- divin stasis aivia-atviare'e Raa ges 0 due 668 
minimax principles ...c.cccsc. cesses 783 
Minimax StlatesY jessie sine sesso Ouse 754 
minimax theorem .............0..eeeeee 102 
minimization of error ................005 656 
minimum 
by heuristic search ................ WT 
GISIANCS a ian id arancasneedawsewdoe 730 
HAVA SAMPLE: 30 503.5 8.5 essicam ae sitieeonigee 587 
16Call ccudeonnwenodsetan cates anes 666 
Minkowski inequality .......... 48, 295, 401 
MIXED ACHONS 2.5/95.5- asl keons a AN Na a eens 783 
mixed prodiict Tle 4 s..scescveweeeeees’ 104 
MIKE: SALEBY cise smrciseseerantwaneas 754 
Mixture PrObleM 05.4 :5..'se.ssneais. seta nee shoo 769 
Mobius 
function .......... 21, 36, 51, 117, 177 
WONG 4 laipea ta scace te scnmemaomecewee te 160 
SUP chine dts paginas Ain te used! 204 
transformation .................-. 411 





multivariate distributions 841 
TNO GS os. saro preacsrirasageceacyetarend dig atasteesarecs Be 581 
MOIS) i-c5.c/sahanss aa Ghenswinewaarseavk es 714 
modified 

Bessel functions ................-. 465 
Buler’s| method y..2,.ca$hea Gk bases 682 
Newton’s method ................. 649 
modular arithmetic .................2000 28 
PMO GUUS se: sstari aces ates ers eosyiaenacanteldtow aia 569 
complementary .................. 471 
elliptic integrals .................. 471 
of a complex number ............. 405 
molecules, computational ............... 680 
Mollweide’s formulas ................-. 434 
moment generating function ............. 538 
TOMECNIS oa veccdas aka ncadearsenes 537, 539 
CONICLED) y6 soem gaprncpaemeitnas SST 
JONES cv side tae, Secehamdte wigeeintaceys bes 540 
Ob WEIS acer iu eeaaS einen 766, 797 
SAMPlO ig sida chaha wire visearie ded asta 582 
Monge: patel 2.5.15: sesceds ane code bans 270 
MONI) sciG02bnedeases h4 a Sasleee en sages 106 
monotone property ...............0e eee 137 
Monte Hall problem .................... ie! 
Monte-Carlo methods ............. 676, 677 
Moore bound (graphs) ................5- 165 
Moodie: sraphi ess. cicie sos iis lene sebate tan 165 
Moore—Penrose conditions ............... OF 
MO fS61COdG igs o:2iss. dees oa SUoederdarnsese 803 
MOMEALS 5 ccyndnsctacoseemeiu unaeines 753 
MOving trhEM PON 6 5:5..9. 3d dee ee vere ae 267 
multidimensional transforms ........ 502, 522 
MUN STAPH, fish b ges aecews hia eeaite Saree 152 
Euler’s:theOrem 4 .iscsciaiiee bate ues 162 
multinomial 
coefficient’. .....6..086e5 140, 143, 144 
probability distribution ............ 554 
multipartite graph .................0.00. 157 
Complete: viscs cocks ceeds avers 161 
multiple 
angle formulas ................... 430 
argument relations ................ 446 
MSP TANS: 5.6.54 sos 5 manda was ene egw 674 
SCTIES 4 denaienn ahicduns anatomy susie 53 
multiplication 
of complex numbers .............. 405 
Of frachOns~.3..uediduexetieewadenes 9 
of hexadecimal numbers ........... 12 
Of MattiCES hci y sche das sae. 88 
OFTENSOLS:. 5..nsrncameheiaaceateacs 379 
multiplicative 
BTOUP tia soncahneiaseageamn ante sates 106 
lagged-Fibonacci sequences ....... 570 
multiplicity, of root of polynomial ........ 70 
MAUMIPHER es sie ts ones are tared ac aeeguveained 569 
multistep methods ...................00. 683 


multivariate distributions ................ 539 


842 multivariate normal 
multivariate normal .................... 556 
THUSIC., sinrssassivanentesanad adigin do oearacea sites 767 
Mmiuituall information: cx. csiws deicnsa denen 729 
mutually orthogonal Latin squares ....... 179 
named 
difference equations .............. 188 
differential equations ......... 361, 374 
integral equations ................ 370 
Napier analogs 5 scicassaeiseneds san cues 227 
Napier rules: xctsdseintaced cbememaenss 225 
Napierian logarithm .................... 422 
Nash equilibrium ...................... 756 
Nash—Williams arboricity theorem ....... 163 
natural 
lOgaTHthMS ...csiisascnrtereessomeeens 15 
numbers, defined ................... 9 
TEPLESENCALLON i s.spaccasecrwiewse eens ee 267 
Navier equations ................e0-00ee F722 
Navier-Stokes equations ........... 374, 712 
nearest neighbor ....................08. 543 
NECKIACES. 0406 sedbedardaesontudenex 21,110 
needle problem: .......5.006.5000 ss seeeser 544 
negative binomial prob distribution ...... 555 
neighbor 
STAPH: gocceavdyes vet vetawkases bas 157 
MEAPESE: t62ens stiri Gdtarisa nace moceac eas at ees 543 
neighborhood! ii. sei sa eee 157 
STAPH: ses crsiewier en seiiasdaree acs 157 
of a point in a metric space ........ 396 
search methods ................... T7171 
network AOW cases cavaass candace eave 710 


solution by linear programming ....775 
Neumann 


CONMILONS:. jasducciiss cdiew buenas 363 
PUNCHON, as teis oc sctclyie eae yee Meaelen 461 
Neville’s method ..................0000- 652 
Newton 
—Cotes formulas ............. 668, 669 
—Gregory formulas ............... 653 
—Raphson method ................ 648 
backward formula ................ 653 
FOTMUAS ss. ceiiciniuetaceaceenatsnes ced 434 
interpolatory formula ............. 653 
LAWS spain scan aratasnaneanes ba steaw hake 697 
MOOT oo .sc cides 398, 648, 649, 665 
polynomial sos. ceeds ccwseen ses 653 
Unit OF [0LCE sas nosxeawan ones nes 794 
DUIPOME 4 tesideitard ctidas cdoteat dundee oy ealenes 98 
MAWIKs.npdinespte mia piahae detaated 85 
MOISE 5. 20'5.4 a odd arkdesacn nan pare am endows 678 
NOME 5 osacras acumen pasoen ows den aeaarees 474 
non-isomorphic groups ...............00% Zi 
non-linear generators ................... 570 


INDEX 


non-linear systems of equations ......... 665 
non-proportional scaling transformation ..256 
non-singular matrix ................-. 83, 93 
NOMUPANSIMIVE 23.4 ae ickdeleatclewided Mises S51 
Nordhaus—Gaddum bounds (graphs) ..... 164 
HOM +5, dink woanneeeteabar dasdenesaeins 116 
D5 Eee eer eee ee ere 734 
TP ened Bade vslaned eehadetet 80, 92 
EP sis ses stievetengentes tenestaueees 92 
DP secs e natacacuaagenareigte a eek 92, 400 
TGS cesssteachaia batvaea edt ba Seed 80, 92, 400 
COMPAUDIC: «.d2c5 5.4 ten ditun aed dca 92 
Bachidean: 5.0.05: csracis ew eashncteenes 80 
FrODtiUS: f.0<s00s eda ee donne edeens o2 
Hilbert-Schmidt ................... esa 
MAWIK: saytisaacad dud apna cameunaaraaens oF 
on a vector space ................. sug 
Polynomial: .s..6 este eakeknes 76 
VECION fiance et ihe nan ated otettenaess 79 
normal 
BASIS) 8, v5.4 cnendnarnrcemametdeneres 117 
circular probabilities .............. 561 
coordinate system ................ 384 
CULVAINITE icine cavineoummemnnd 271 
CIRC CHOM acca ameter Seok eeneeesee 257 
CIStHDUTON: byt touted aia ae 587 
EQUALIONS: wind cs eve ceeenecroas 611, 656 
HORN nhvcckaeknd eed adcudeewacd 209, 257 
MAE ajsuccusaddealaxtantade aad 268, 271 
MAUIK 4 nicer d aussie dian somes 85 
Plan vs isevwi tice sedersegen ses 268 
polynomials: o.3cciccsniseenseeeess 117 
probability distribution ...556, 629, 630 
subgroup ..............- 107, 108, 118 
WECHOl sac cscceccesas 81, 268, 271, 274 
not, in propositional calculus ............ 761 
notation 
CONWAY -6.isecicaec cease ies exownes 203 
STAPNS sscasash oni esweeressumemnas 151 
DAS ood cnasy aveenevn ainnaciincen seb Buds tiesecast ates 811 
INP scccieagtan.d atioret tines eaateu Toa, 430 
n' repeated integral .................00- 510 
n'h root function ...........000.c cece eee 421 
null 
hypothesis... sisss.adecawaws cave tees 582 
MARIA sigh Seeded ded Gee eee ne wees 83 
SOU vega Asn y acasatnnsysiuaseuntes sum tetsett 135 
SPACE tid Savise wath iturin sine shes 96 
WOCHOl .cc4 cad ieaeenapesseavend 83, 382 
number 
AVORATIO' so vcataciorsda nnd eoana es 800 
CHQUE wiawuttncaniareusioreokeess te 153 
complex, polar form ............... 10 
crossing (of a graph) .............. 154 
PEPlCAtlON 0. sei cies cadena donde ee 172 


HHEOFY. abc's sgcvedeoddednouersinenes 28 


INDEX 


number of 
GIPTAPDS 2s. scg: ge Kaede d caewhonees 168 
SLAPS acai datouaunsenicreween 168, 169 
TUUS 4 bands daeta ak totes 606 
MEGS: 2208 bn eatenrobiees 22, 167, 168 
tals. C.Siaisavvastaediouesevazrd 620 
numbers 
DANG: inssciustncame apap pases 23 
BISCDIAIC ZH ieiassatenalsm nes Wastbreweh baie 9 
Bell ccxsoneoncneecaweyeasenes 145, 393 
Berl aii haa weeks 17, 60-63 
Carmichael fig ian cae dunia baa dveces 28 
Catalan: Avicsaiesnzieratesaianiaiatdieaetane 144 
chromatic ....... see chromatic number 
complex ......... see complex numbers 
CONGINON gucsuconceaeaweaweeaae 94, 95 
edge ChrOMALIC 0. soewiis bike este ye 164 
1 50 (=) can ee eae oar 18, 60-62 
PibOnaGed Ghee di as 18,21 
hanMONIC 5.64544 ae weeadeweaneaaen 47 
LatES si case chs tint nceseotampansed we ej 
Natural i sscksewwe% see natural numbers 
PAltiONS OF iii nessa d ou adn naetee 6 145 
petlect: ocictagexcensaeoxeekaeeees 46 
PHME 5 oxrscasaceens see prime numbers 
rational .......... see rational numbers 
TOAL, 2..cnahataing sabe ad oe see real numbers 
TONCONUPES: 5.6) esac ce saicaw das caames 144 
representation ...............0.000e 10 
ROMAN nish cinerea yscaderawesannees 8 
Silalll cnc ccdundebenekudaredaenqee ees 7 
SPeClal Bas.cewaesucitenwaededtan 13-20 
SUING: ss ede tals see Stirling numbers 
transcendental ............... 9, 14, 15 
TYPOS sug lee eeeesincreetiweave scence 9 
NUMEPALS®: 0058. disse aciin lea date ata eetaaee dane 8 
numerical 
ANALYSIS. ukoowtewkedvecnn see eoselss 646 
differential equations ............. 681 
differentiation ..................04 679 
INCE PTALON. o.5svsineccnaeedeiesmewisted 668 
linear algebta. 06.05.4059 cases combs 659 
OPUMIZAUON! iso nes teenage cneaes 665 
CQUACTANIEE® cin5 swnddesten aden emaunne 668 
solution of algebraic equations ..... 647 
summation .............0ceeeeeee 688 
Oblate spheroid: occ. 66 caa sence ewaeaens 220 
oblate spheroidal coordinates ............ 391 
oblique coordinates ................ 198, 199 
oblique spherical triangles .............. 225 
observable vector .............00ee ee eee 734 
ObMSE ANGIE: .....5 ccs cemesice secs nce sana 425 
obtuse triangle ..................00-0 00s 212 


occupancy problems .................... 140 


orthogonal 843 
OCtABON! oc. son.csdacuMenaneueeawee waa 219 
OCtANEAOM: .¢ 5.5150 sie Gack aie dsern ard eaca ws 262, 264 
Octal NOON: 65:55 beedcandeenaea de sae 10 
OCIONIONS: 2h het aiiioledd dvcdaed waned 114, 115 
odd 
SFAPD cee nse stewsainig este meemars 160 
harmonic series ..............0.005 55 
PTMUtAONS icc soagisssievewsieswe » 108 
odds (probability) ...................00. 546 
ODE. i 3.680 see ordinary differential equation 
off-diagonal component .................. 83 
one-factor ANOVA ...........0. eee eee 613 
ONCPOTO, .ocaacacccecsesctadas neve 288, 709 
one-sided Chebyshev inequality ......... 542 
one-to-one function ...............20005 394 
ONO TUNCHON: 2% 4 :o. dois sarawsces eeseaaas 394 
open Newton—Cotes formulas ........... 669 
OPEMSELs 3.8 Saschasicer nad Meal neonates 396 
operations 
DIAL aie pues ct geeec sees as odes 106 
ON STAPNS sca dn rae ce Seabe. Seasis a 159 
Per SECON. « siscaetinaineuew aekaien os 403 
PESCATCM? eica%. ose. aiaraiaesad ap aibaee wie ecerese 769 
operator, d’Alembertian ................ 368 
opportunity loss function ............... 784 
OPUCSi.2 farasel werd dae eadot oa Det leon ad eens 718 
Optimal) filter’ o.0...cceds swe rasass endures 786 
optimal; Pareto: s2..csccccckoubeaseas ens 754 
optimization, numerical ................. 665 
OT, CxClWSIVE . oucdasacceoagoieneeeeeess 569 
or, in propositional calculus ............. 761 
order 
affine planes o. ci ddiiek sav ice thaws 176 
AXIOMS OF ws.cso decane dale epulneee dos 395 
IAMS 23 siccis ad ance cS abode aes eas 107 
OFA CULVE a:5 sissies Aynsew aenewaleces anaes 240 
OP BSTapD! ays ray somes ca acne. < 157 
OLA POle. vc bcayaiscnnaSdan souselen 408 
OP AZELO-ssccsiemaanancansuesee ees 408 
of an algebraic structure ........... 106 
Partial! ..ci.:cceeeicwsias vadveo rages do 138 
STALISUICS. sac ede vanossaneodens 580, 587 
OPdSTiNS OF SES) 5.3055 dado ween g esses 138 
ordinary differential equations ........... 350 
MAMIE 5 scisiendanteangeerrapavs acavanelstenoaiens Boars 361 
numerical solutions ............... 681 
Ore’s theorem (graphs) ................. 162 
OPISID) sey yaaa da aasiace Paes 196, 249 
orthogonal 
coordinates ........ 368, 386, 388, 389 
HUNCHONS <5.5.055:0.5 sa sass Sarena ea dias 401 
Teatin SQUALES? wise cue keousinvores 179 
WAIN cc0cecapennexensenes 85, 95, 385 
polynomials ............ 451, 454, 455 
VECLOLS...crssieinad dot Sndiues ceasease eed antes 79 


844 orthonormal 


orthonormal 
DASIS' sci nstspastaeneenunteesmnaes 789 
FUNCHONG ie-4 s.casneetwteraeetece se 401 
SOU ahh dataset vet katana 401, 402 
VEClONS cist tantnca Veta dee teens 719 
oscillating plane ..5:< sacs vases avannseres 268 
OULER PIOdUCt. 25.90 ob edeudetans de reancaas 379 
Oval, Cassini’. ocecxsavscnaasadiecade es 242 
GVSTAAMPING ois susvistea wear auelsienrwesd 355 
p-adic NUMbErS) siete widewdadece ocdanox 23 
Painlevé transcendent .................. 361 
pairing terms, ways to ...............00 144 
Pappus—Guldinus theorem .............. 219 
parabola: csascesccnes tae ees tne serreneus 229 
PEOPCTUIES. cscs sce ceedseweea nes 237 
parabolic 
COOPdINATES 6. ecw ceases evae ed 367, 392 
cylinder coordinates .............. 390 
cylinder equation ................. 361 
CQUANON ses csisia sedate sae deed bees 362 
partial differential equation ........ 687 
POINE. ois.¢ 5453 g.ks naa readn wernt dows mes 271 
TOMECION sca da tape sn tdhrenwuau ass 237 
paraboloid of revolution ................ 274 
paraboloidal coordinates ................ 392 
paradox 
BIaesS cuca tati aan ath anas tone 756 
Of SERMHEOTY. oa: aais sed nano nna a ee 137 
RUSSENS oc cdsegc esleradaens adneee 137 
parallel 
CIASSES) tisha ntacactnasgetetanss 176 
LINES si.05. 4 cuvewpmadeanyee waa gels 211, 260 
DIAN ES 2a sisivectssce tsa autiveuash tense aces deat 258 
POSHUMALS Ys arias Axed cs eattagereadlisehcera!s 176 
SYSUEM) saoeicc en egergnndned yea den aT7 
VECIOIS: Jb vic oewlancmsdnniuendgedwneings 78 
parallelepiped ................. 90, 261, 290 
parallelogram: 3253.6. s rere eases 81, 217 
parameterized CUrVe: us. osseous ced ence 379 
parametric representation ............... 234 
Pareto-optimal outcome ................ 754 
parity check matrix ..................0.. 731 
Parseval relation ..... 462, 497, 501, 504, 513 
Parseval’s identity ....................0. 402 
partial 
OHVAlIVE erosagtarewiaianentenee un oa 2a7 
differentiation, symbol ............ 380 
TACHONS 4 ceusace 72, 73, 297, 511, 514 
OVMED .eicactnvdesnei eck e Oeewnus 138 
PIVOUDE: 2414.6 sc aac end cateiolneioecinteniers 660 
SUM) 4.Ssstp an satnaoadcann aeawme sacs 47 
partial differential equations ............. 362 
CLUPUC: srs si deiidmting Saedingegeunen oe 686 


INDEX 


partial differential equations (continued) 


hyperbole .a5.c.5.00dadcad sae eaaess 685 
numerical solutions ............... 685 
PATA ONG: oes scree ants adeeb vache 687 
partial quotients (continued fractions) ..... a1 
partially ordered sets ................... 138 
particular solution ............. 350, 352, 374 
partitioning 
for matrix inversion ................ o3 
ILE SECS” isin asisiesaxcous eu aarnw nen ee 147 
of determinant i. hy sch cen ctceay 91 
partitions 
DIMALY. 6.asccenisederiaetartinndcenins 22 
generating function ............... 145 
in combinatorics ................- 140 
HUMBLE IOL 5 565 5: evs asdann bape donee ssice.s 21 
OFT Sitand- cama tones taae wen see ees 21 
Oba SrAp ei shres es tibetan a sttad 163 
Of a DUMBER ibs hae aaeees 145 
OPASEE odes donne ans temueacmanher 145 
Pascal 
CiStHbUHON! .i.4.s9% waive etal as 555 
CHANGE ask anaes das nha galers 142 
path 
aILEMNAtiNG wis vis cae Soa es. 156 
ELtS40 Co) 1110 en ea 156 
PTAPD) -5.5,5.08 ewe dea dcane denies 157, 160 
Hamiltonian ..................-4- 155 
SHOTS, iiagauies ondans art athaceiracenes 716 
TEOTEMS) 23 ske irs Bacto ededone Pea dedec4 162 
pattem INVENLOLY scious eee see eee 110 
PDE. s.cicexses see partial differential equation 
| O(a Lame ete rare acre dia tar eee rar rR ERE ener 621 
PEAaNO CULVE! 6... desonsedeees hdc anor ones 247 
Pell CQUALION: 5..4:ceiieaaerianterteesd eines 34 
PSM MM: ccs sinietace sient awtears ey 697, 798 
PeNlAgONS:..c.c.nwrsssatraetesacus 112, 219 
PStCentilEs: sxc cece scenes 580, 585, 631-638 
perfect 
CODES. duc sidokhnedteend dks bated Fal 
STAD ch iieeiaseuvcaon scat dnamens 157 
MUMBETS® vs.c nara narnd Reaaruaoageaens 46 
perfectly conditioned .................... 94 
Perimeter, SEMI) 55:65:53.5, 48 Hessen cnersandss 213 
PeriodsOF LUNCHON) 24. ce 2c keuvsiew kdb aices sg 54 
periodic 
autocorrelation .............. 182, 183 
PUNCHONS : 93S seh4 vvcklaes Sin osaca ta os ah 54, 57 
functions, doubly ............ 474, 492 
SEQUENCES) 4 5 sidiachen intestines shaven oes 182 
PEHIOdiCltyy iit caGea ta weds ale branes 426 
PEIMANENE sc cdicuscresewiweedaseeses wae 91 
permutation matrix ............... 85, 91, 99 
PETMULANONS: ws eidceciens cehde batunies 150 
COStaS AaIrAY’ pidateaoudeteoaes 5 786 


CYCIES IN sis ox rode oeievterduasnnds 146 


INDEX 


permutations (continued) 


derangements ................. 22, 144 
everband Odd 2. siieusitweiogedowesess 108 
STOUP schol tuadine  watene bas adios 108, 109 
PNAUCIX: scsi Sis ana e veeSuatd) Blo 103 
OLMAICES! oi: rc soe oalne necnareae 380 
SYMDOM! ccs. cc0 gheavedeokesgeeeseccs 385 
perpendicular lines ................ 211, 260 
perpendicular planes ................... 258: 
PSISYMMEMY. Lsccscivecussves sevesser es 85 
perturbed problem 4... cccis eat exeadnns 681 
Petersen Staph oie sic seevaiecerisarnetsaas 160 
Pfaff—Saalschutz identity ................. 51 
physical constants ..................0005 800 
Wy adatargoararsoa nase paren sn eee see notation index 
Wi, POMMGNS sa coyadusa eed asdwaedebadeeas 760 
piecewise polynomial approximation ..... 655 
pigeonhole principle .................... 128 
PIVOUNES ictal x eh eat ee tas 659, 660 
Plana formula icc. hcesic seus edeaee bee eaon 63 
planar 
GtAPhs vsc.sesaceviacsaes 157, 160, 163 
DOME wisciaatelsastewacasi eacece Gouna acd a 271 
(HAN CIES 5 ixicatincuientna swum oegen ees 433 
planarity (graphs)! soi... .c6 eis cecces cous 6 165 
Planck’s constants .................0.008 800 
Planck’ SAaw ond esse eacodnndavdwonnewnes 724 
PIANE: wisn eve dations carensadiane shamans 257 
AMING! scamrcasnder vag iG seer yactees 176 
coordinate systems ............... 194 
CUEVES sg: naman. arewainatoceeee omtie 240 
QUAI! Socs.dcmo ws rhaseweesie wins 250 
graph embedding in .............. 13¥ 
ISOMEUIES sho. od cna din ee vinees annrainns 200 
NOMA! ss isivcusegre paused aeacdsre 268 
Order Of affine 5). siescneineie sc hewsee 176 
OSCUIALN Es. cxietarcsnmaatnnenies ena 268 
POMS IN ess sev oeerewae ginecmaey wenn 543 
PLOJSCUVEs ccciccSaus noes gkegesinss 176 
POCUPYINE 3 suddenness ea sonsba ins’ 268 
SYMIMCUICS: csi nd cadde amen a ome 200 
TAN GENE 2:5. wishes wnese Bama deconae eats 271 
transformations .................. 207 
Plank’s constants ..............e0 eee eee ee 7 
plasma dispersion function .............. 476 
Platonic SOUS) ssisediac dc chesleeulivedsaes 262 
Pochhammer symbol ..................2. 16 
point 
ACCUMULATION: n.c6 aes came w wed eres 396 
CIUSIER iui siie'sichanrmns eaten: 397 
COMME jeanne vee vels ea aide ain we 
CHUCAll sisssutenciecetnes aoe Meese oe 362 
ENSIEY: id cishhasio ses omatod.do aris euis's 543 
CMP” iectidea heednnes ataeher’ 270 
estimate ........... 609, 613, 615, 617 


polynomials 845 
point (continued) 
hyperbole. .caieca case nacegu eon do 271 
in a line segment ................. 543 
MA PLANE: cscs graves wediedsdeedke vans 543 
in combinatorial design ........... 172 
HMI s.caedhatedoa thao wie’ ene Sees 396 
NEALE .cscnsc ce dcen sede nakvas ens 543 
(0) ie) (0)<1 11 = aaa ee 396 
Parabol:. +; os43 selene vite aag wanes 271 
DANAE sande saceaswme aes senna 271 
UMBIICAD issues aoeaseacs ata bacebede 271 
pointwise convergence .................. 398 
Poisson 
AETIVANS: dae tea soins cutie telanaucres 563 
distribution ......... 536, 555, 594, 641 
CQUANON a. i2a6 indaecean am aasauren 374 
partial differential equation ........ 686 
[PIOCESS bss vice Net dati aaneey nen eee 578 
summation formula ........... 63, 499 
POKEL ni55icvhiueradardeade cer aoneceadior 7, 546 
polar 
ANUS ssceiscadhsaiesiusataisrdtsgud ohiarecect anes 250 
coordinates 197, 198, 201, 245, 289, 385 
ACA’. S sewkorumaveemmeadateaces 212 
form of complex number .......... 405 
DOLC tes Sissi Me sdiateatae tata wes haste 197, 244 
of complex functions ......... 302, 408 
Pollaczek—Khintchine formula .......... 564 
Polya distribution ...................... 555 
Polyatheory’ aes uid.iebs masa emda eae 109 
POLYGONS” 25 Seward aetunotia vreeacens be 211 
POQUL AM ae nodes dearete ds tredeAhare cigistein ats 218 
DOlyhEdra: sicawwividesasidnbs dann antes 262 
CONVER ..nsceaee cde daria gew aoe 261 
NCS: sa ruesdarvigeting eb-ae wena gerne acd 264 
polylogarithm .....................000. 488 
POlYHOMIAS. isc ssrsanasieasea dleewwiem deems 70 
approximation theorem ........... 309 
Bernoulli gc ccacscsvaeuee secesee een 17 
BRO rmsteiny: ics sedis cuties divta asad nate doteeon 657 
BeZiet siokcsisondarinetsowneda ete 657 
Characteristic: ca.snnecaeebehaee wed ads 98 
Chebyshev: ssasis ssa aiececcnnys 453, 671 
CHOMAUC:. aciisiedae ta eoanrsoneatewe 164 
CUBIC si aictenctanseoeselatarnts ie aites 74 
CYCOLOMNG 5. ogden Vee thers teke wee. ee, 
EBTEG Hs sas oviede chs wenkasasidee stinss 114 
Buler ca ichadaacarnetateece hats 18 
evaluation (Horner’s method) ...... 650 
OL ot | er 146, 147 
PENSTAUNG® 505s Sicseaacsay ers anon vers 731 
Hermite. .scxsdaccasnewvs 451, 654, 671 
interpolating 66 vwenekscerane ewes 654 
irreducible ............... 20; Via, ae 
TACO 5.54 hiwscsisaytia da dustoe 451, 454, 671 
LASMEITe: 05 csauinesareners 181, 452, 671 


846 polynomials 


polynomials (continued) 


LES CNIS! 2.514 sjncdasacatet anaemia 452, 671 
MEASUPE igi san gasewatoekd shone 76 
MONIC i. 5.6:3:) Le Sas whe 114, 130 
NeWtoll cio asin a wee ckeui sacs 653 
NOMS gasrendeaihaenaeieeaerbes he 76 
NOMA. b4o cvcerarsgaaen ctectscihes 117 
orthogonal .............. 451, 454, 455 
piecewise approximation .......... 655 
primitive ........... 114, 117, 130, 178 
CQUAGEAUG: icoch nach dah sides ttn eed % 
QUMATHIG” eecspis dining deritinend aa daisie edoses 74 
QuOtent «ace cdi ding dae sees neonag on 72 
TESUMAMNE cic cae eosin epee ood senewes ie) 
TING: ser scareiaseraseicadoasaG ning sta nore atacesasooss 114 
MOOK: ep op cases tamara Saucon tare 181 
TOOUS. 25x sexauinasisidiaans eu mapomre cir 70 
solution by radicals ................ re: 
symmetric functions ............... 7 
symmetric representation ........... 76 
WalUAatOt sings ae adasceeeetasece gers 76 
FTC? isin tedeaizcta piarstninres none acetone wh 456 
polyominoes ...............0.0.00008 22, 782 
Pontryagin maximum principle .......... 735 
population genetics ................0.00. 716 
portiohOtheGry woes silos d deeds Tod 
POSES cies cee esdduedneiaotinoamsdaens emers 138 
positive 
ENMILE: scp sencac spans 101, 382, 396, 399 
numbers, axiom of order .......... 395 
Semi-defNite:.:.é.ckavaaetevars dees 101 
postulate, parallel ....................4. 176 
potential equation ..................0000. 365 
power 
ANGEK 5.0.0 ois wae newsreel amayeaaeasrs 801 
method siaiwsacenkdesatens 660, 661 
OMA tESE ances widiacinlstnane naan saws 582 
of complex numbers .............. 405 
operation on graphs ............... 159 
TESICUES ip toen esa stent Maoden-ee 128, 129 
SEHES. vichidonionacnigadactismon see series 
SEU piglet Gnd dba Stee ddan eavarinars 136 
UNIS: «teu ora OsGroasa dune sekesmras ToT 
VOUNE yh. fe cea cnncawes see voting power 
powers 
Of? veticuwtanabvekenawesee 6, 13, 22 
OL MO! dts iei vutents Sdaostes death dees 3 
MAMNES 3 ais:Gh Sahel seihele nese neni skeen 6 
of circular functions .............. 431 
OMIMUSBELS) 3. ex nahgne enelemmeesinds 19 
of integers, negative ............... 20 
SUMS OF ak cc newreenacneexwes 17, 18 
predicate calculus ..................00... 763 
PTECICHON pid 24 dep acdsee hadies uabentodss 784 
predictor-corrector methods ............. 683 


PLELACE! :cciarciscncQaring pannsabseemeadanedae xi 


INDEX 
PICHXES 34ic ad nalen dics gheanads Renronats 6 
Present ValWe iss. s cy cama ddieaaulemia sas 746 
PHIM: sda harsaithaen wey Ggnadh agate me BT 
FACHOTIA hs saree eh ture Maes eae 40 
Prat 605045 ava dota see 40, 248 
formula: 43 haces asiceasinataneies 37 
IMG Aall 3.5,2.35:4 ond taorsaeanaenenons 113 
in an integral domain ............. 113 
in arithmetic progression ........... 39 
VATS: isd ieG sa nwisid onan sua scams 39 
less than a given number ........... BT 
Mersenne .......... 21, 38, 40, 46, 569 
POWEIS! (avis osc Sie Gud ohdoacamem hers 24 
PTObAb less cis.dutcandnotlnnagtese onsen 38 
proof of primality ................. 38 
quadratic residue .................. 29 
PElAtiVElYccicoseetnerbaconayenes 35, 46 
special forms: wi evasikoauead< 39-41 
VEST so siisnd aide arattacadctneinn sbecussueans 38 
(WI .peacdasvhsaesdansoscdvney 37, 39 
WAISOD, is-i05'6 dod dat earns nag ans 39 
primitive 
SIEMENE siacsuanaiasuaarn geaaawe 117 
polynomials ........ 114, 117, 130, 178 
TOOUS: secacisacoadaawenaacrerece 38, 131, 745 
trinomial exponents ............... 570 
PHN CIpPal: 5 zis 550305 phate caawaras ons 746 
curvatures ................00. 271, 274 
CiasONadl in5% avduenemeGhuannaoliniuc 83 
GIPECHLONS 6.4 s6ac ode ee ee 271, 273, 274 
ideal domain ................ 113, 115 
MOKMAL ME 5.0 baie ssa heirs wasoneis eens 268 
normal unit vector ................ 268 
root, of acomplex number ........ 406 
sub-matrix ..............00005 87, 101 
WAIMG: ss cuaticuteeaewenageas 441, 505 
principle 
MAXIMUM 65.5 seas cawewe sooner. 735 
POONA ciicecaiaiarn ware wine ne Guo ates 783 
of the argument .................. 409 
pigeonhole... cc: coe c cows nee va 139 
Rale Gh 'S\nsiaccitinnadcdae gn wakes en 102 
PHONILY SENVICE: ee ncapanheaedws ome maa 562 
PHS 3 hon odin okes Dee eae aoa easaad 261 
prisoners’ dilemma ..................... 756 
probabilistic algorithm ................... 38 
PTODADIY horcindaadu Swag dee sasiaentars 535, 628 
ANA SEtS ulated. uberis laieeteck case 136 
density function ............. 359; 621 
MEASMEO  rsisie‘an.rernesnOens eae, 535 
OddS? wi asncne sige Sralenatanaetes 546 
PALO TOSIS: 2 sateanisia ciarecacaace airs eateries 608 
ThEOREMS! tiie sch douse uses ses 536 


INDEX 


probability distribution ............. 537, 550 
F ...558, see F probability distribution 
besos’ see t probability distribution 
Bernoulli: sicscusas.cevatcse hotness §53 
BEtA: stoi Bisnett aR tceeel leds: 557 
DiNOMIal osc5:csp se ricvansaeasquaiees 553 
CHIESQUATS: seas euiat er ioaage dada’ oo7 
GISCTCLE? aas:2:sexicfaies satan anteecunices 553 
CHMODY 3s costae saerdiaulaoerantacnautamie 729 
ExpPONentiall is cs seeseuaweensmecas 557 
AMMA yi 4a devs iceahinr a eatimes, cae heen 558 
PCOMCUTC 5, 8 sais diac dah atteoe ses anise 554 
hypergeometric .................. 554 
multinomial 0... 0.6.0. e sees cee ces 554 
negative binomial ................ 555 
MOCMAA sy .scssscocdesreespdeartsatnarecartie gies es 556 
Paseall co.cc ccotesleneeiieeds seas 555 
POISSON, Pcs vss teanacetees Sacenenga aeons 555 
POLY a! shat Datta ihe tte senate $55 
SNCUECOM SP wiacisecpiaen ede dees are 558 
student’s t . see t probability distribution 
WONG 5 cu sadevaa kaaweagnns 553, 559 

probable primes... icc eae cesnees asia 38 

problem 
ASSISNMEHE 05s dota So wemueneee Vs 
TeAastsSQUATES: sicisa siesta etic bella ene vce 97 
SCHOO GA ccc ceice ye eedanes eaiaeiees 180 
traveling salesman ........... 778, 780 

process capability ..................0000. 579 

product 
CX(CHOR 2-0 sist newnidertaewee sarees ¢ 288 
SLOUP! ssid dwateaaraa baer sae you ease 108 
AIA? as Shea Me atae deeb ad Medinet eat 65 
Kronecket’ os..esicesiceeceent eae ines 104 
law of reliabilities ................ S77 
of cyclic groups ...............46- 118 
OL FOMMS! 4 s.ap pr ciasinedinlsneamaeets 288 
OFNUMBETS' 3 daexsswnaesaavewnes nee 47 
of random variables .............. 541 
OP SES 2s. bis sister drne toa ovacs era cunnssenrehs 393 
operation on graphs ............... 159 
QUIET cis ss coined yd eowaadae wm ecarsin’ a9 
pseudoscalar i.:ci605% secone esse as 360 
TUNG sss. c pistoy creas dea pte Cangas 104 
trigonometric functions ........... 429 
WEdSE: 2oirgiigitew chav iaveaeee es 288 

programming techniques ................ 688 

programming, integer .................. 774 

progression, arithmetic .................. 69 

progression, geometric ................... 69 

projecting ascene ..................000. 256 

Projection MAtHIK vscrcsisec. Seowxens 85, 96 

projective 
COOPEINALES: isc dsceire sac duns anaes 198 
PIANC cs apron sasioisdaitis done batais 176 
transformations .............. 208, 256 


quadrature 847 
prolate:spheroid ives isie cis cae sea aeen ics 220 
prolate spheroidal coordinates ........... 391 
proof 
IDYiCASES Att tr esate ae Sita 762 
METHOAS 13.52-Sorsisa signs wie vbarl seteateren 781 
Of PrIMality: ...ccedesdigadaoageaheindne 38 
without words .................0.00. 3 
proper ideal fac)esccdaws ca uenastbemaaulen 113 
properties 
local) 62th ooaeoupemnee Se eeeee 270 
MEGAN <3. joricueca Wherinetdetsnbaayats 5 
ofintegrals: 1... cccescssededtaaebs 292 
of sets, inclusion/exclusion ........ 139 
PLOPOTION cc scerccamennh ached ss aduscos 69 
proportional scaling transformation . .207, 255 
propositional calculus .................. 761 
inference, rule Of ... 46.00. 008i6ees 762 
relation to predicate calculus ...... 763 
pseudo-inverse ............0. eee eee 94, 97 
PSEUMOSTAPIN 66 ed adas de eeeddbwedede ens 152 
pseudorandom number generator ........ 568 
pseudoscalar product ................... 360 
pseudospectra 2.0... . cece eee eee ees 85, 105 
Ptolemy formula .................. 217, 239 
PYTAMNIG, ise coewseakeredsignor ace ee aw anc’ 261 
MUTI CALCD 5 adh wtadiatacenniaateanin sacs 261 
Pythagorean 
theorem ... 646 ces sens 3, 429, 432, 433 
(Ples iccsm tye ness Ram ieaane lames 33 
QRalgorithm 0046. sekyeeedes 663, 664 
OR ‘factOrization......icsesceueteisecer ese oD 
QUadtaNnce: s svetiesegccee eek wgnennene ric 431 
QUAGrAN GICs: 654.5325 to,se scpie earners ren es ail 
GQUACRANL: ta.sscaaiutarsnsrsitewds mama eptes ayers 425 
determination ............... 225, 227 
STOTIS: cites 5 sshs tndeh ashe escape nests 425 
quadratic 
CONVEFZENCE: oss cde eeee banesees 646 
CQUANON: ine dues ceheen eeeone 73, 232 
TENG. jah eenre one encadesnadaniens 116 
WONG: .cy canada eonatccinat 83, 101 
polynomial, discriminant ........... a 
TECIPFOCILY: “seciatsc bcs bea diene iaes 29, 417 
MOSTOUG) i Ge cs.0 8 did ence teased Rice Moareee 28, 29 
quadrature 
Chebyshev ..i03 des tees ce eine elenaien 674 
Gauss—Hermite ................0. 672 
Gauss—Laguerre .................. 672 
Gauss—Legendre ................. 672 
GAUSSIAN 4354. 5sc deine se aeettrateaes 670-674 
TOD ANOS heise nes hk cbt iced deedeataseastcents 673 
Monte-Carlo methods ............ 676 


845 quadrature 


quadrature (continued) 


over a polygon ...............040. 676 
OVErATECINGIE cox cdsewow tans 674 
RAGAU) 25.55 site nsicnin ood ee Rh nieth aeacendengited 673 
QUAMIICS: osc bana et acewr eens 219, 222 
quadrilaterals ................. 211,212, 216 
CYCHC sas anetaweeatard erable esos 217 
quantifier 
existential wc sisinsisstea isan ae ae 763 
UnIVEeDSall 4. uy tans wag ae eseneus 763 
GQUATONES: iV sda Pia seuist Waa dudmaunea lets 580 
quantum mechanics .................00- N17 
QUATHS so. d sete vee anos ualineoneensae 580 
confidence interval ............... 589 
AeviatiOn: ys cence nccsedialensalea sac 582 
quasi-linear equations .................. 373 
QUatEIMION ices. vaicdakenunacetnsameeas 719 
dIVISION TING «ch joes yan ceweas 114, 115 
SHOUD ihc tide ten vneege es anaes $21,125 
Characters :...csvagsiannneckeats 128 
QUEUING: THEOLY 6.5.5.5 ode rnendmotamememers 562 
quotient 
PTOUP! sated aeanereadagivan desler 107 
TElAUONS:-fscrkaacaens sweden sens 429 
PINS. So ueutannceneqeueasuseatwe 113 
SPACE irt.c 5 ace waeira meecree tine maceun ned 203 
PAGAR a. ll aek hae Bile Maretina be ela Raced eses 720 
Radau quadrature: .. 3... ccs 05 ceane scenes 673 
Radau weight functions ................. 670 
Rademacher function ................... 793 
PAC ADS 1565. secartidaaia gta doaee was whee a see etacone 8 425 
CONVERSION os ces gicie tones cia ve taseeeee 440 
radiation condition .................0005 365 
PACICALS: 5, sscsys. sted nee oaten Gear seeies Migeealoinenss 7 
TAGIOACHIVILY. ood ccs dans oe ows wee dae ees 695 
radius 
circumscribed circle .............. 433 
inscribed Circle 56s. ceccows eae eee 433 
OF ACIKCIEs, ofiioneniesiegawenedeens 237 
OP aSraphl iGo seladvneinidn teas 13¥ 
OF CUPVALUTE 45 vide Geka sea awe es 268 
SPect all s.c05, cess vaeaanradsane asec 100 
TAIX wi scacenenedhath« eoadewasnemanes 10 
raisin cookie problem .................. 552 
Raleigh’s principle ..................... 102 
Ramanujan summation .................. 64 
Ramsey’s theorem (graphs) ............. 163 
random 
MAICES -..3.0.9n sce yank dcednwaand 574 
number generation ............... 568 
SCTVICE: Sic su-bh om aranetaeepaas ceed 562 
SWALE RY). “ape sna tealaninnntie saab as 754 


SUNS aia teetcleudegenwatoaeeueras 544 


INDEX 
random (continued) 
variables ........... 136, 536, 537, 729 
a re ae 550, 567 
PANGS n.d Sabieracnesytayaceae wd advereneedehane 582, 585 
interquartile: (us ies eek ae es 582 
Of a MUNCHON 625 viemcdadalscagiaar 394 
SPA! och svgcsheened varansmevbaes ad 96 
PARKS jet sjerasarecaveiaie acass Seiyay@hacae alecaereieere De 93, 759 
CHANGING casera nsie!sspsantgatesernanr itis 84, 97 
tate-Of a'COde: oes: cade wsiaaieas oa sean 730 
fate: Of CONVETBENCE: soci ian eek baa 646 
ratio 
GLOSS as avcacestishoaatadieia is tas Soeoce pees 411 
F0) (los nr eee eee 16 
HOSE scr aeke kuna neadeaodarehaeead 49 
TatiOnal: CULVE 6.6.65 50c.dorsur dae ener areeaas 241 
rational numbers ................ 9, 393, 395 
rational trigonometry .................0. 431 
Rayleigh distribution ................... 558 
real 
ANALYSIS: wae sag uh eames ss ewaeees 393 
MME! SUDSEE s-scis-nctisiaravarnnesnena actos sia fusdee 24 
MUMBELS'. 5.525 sss:aie' aoa 9, 394, 395, 397 
part of complex number ........... 405 
reciprocal relations ..................... 429 
reciprocal System i...c0% as ers eee tas eens 82 
TECOMNSHUCHON 6... esis case ee ee aw aces 499 
recreational mathematics ............... 782 
rectangular 
coordinates ............. 196, 249, 389 
NY PerOol a icsiaaderviae.s dediemds Meese 231 
MAH 2.0 dvsgavdeyexd sdargedecesiaes 83 
parallelepiped .................... 261 
rectifying Plane. vas ssc eves aeewane vers 268 
POCUMCNCE ceeds recede cde seaseacee ene 566 
Fibonacci numbers ................ 18 
POLAGON 6 ssc Sisaieie asa vie sternal 144, 478 
reductio ad absurdum .................. 762 
Reed-Solomon codes ..............5.055 tol 
PELEPENCES) fic tds ed i cathueret wo cease gmion ses 805 
refinement equation .................... 789 
reflection ..................005 200, 252, 715 
reflexive relation ......6.cscesee ees 138, 393 
PEPFACHION 45. s:00ihe wae ares cand ena dd eed aeee 715 
regression, lineal iscsecsceeceees. ee ees 609 
Pesret MNCHON ssvviceraeod idee aaadesees< 784 
POCUIA TANS: i Saad ae ca vibe aatatage ieee 650 
regular 
CUIVE 2echeeds cdeecdine ee eeenins ene 267 
LADD seis tnatessseatraauneauevaaiseniae ta 137 
MM AUX ase sieceisisss cade von n.d ae a wlelge ies 83 
parametric representation ......... 267 
POLVPONS: sides caster esesn oaewaree 218 
POlVHeda: <acictiacde stared dad anies ¢ 262 
rejecting a hypothesis .................. 582 


INDEX 


PTEIMUONS: csc eakomuamaaxeupatasaweueee 393 
CQUIVALENCE 5 sccsditiare He wssnaesesinas 393 
IN SES gs.ccegad oxedaaweenaave cake. 138 
TGS GHEE! ci 8 via etd e teva ie eee 471 
PEHEKIVE!:.05:5.635.55.4 Livsatine eSaeaasm anes 393 
SYMMECWIC soca dwagcnsandea eaniens 303 
transitive ......... cece eee eee eee 393 
relative efficiency .................0.00. 583 
POLAUVE SIPOT isu sree csueeas eevee sd oax ene 646 
felativellyy. Prime: ici disc. ciaroa sive ss evaews 35 
Ts] 07216) 1 ae ae oT Sif 
FUNCHON 250 c ty cdvorsanadaduss 578 
TAWFOT 1 p.c\sraSierats uno adadendcnenda mavens ai? 
remainder theorem, Chinese .............. 29 
remainder, power series .............2-005 50 
removable singularity .............. 408, 409 
FENCONITES MNUMDE!S 4.0. eds cackwdaseeves 144 
repeated integral 00.4... sas ceeeene ees 510 
replication number ................-.005 172 
PEPUNILS 2 bese natanngntescadiasssces 40 
residial design... pevvine ware mnaeeesewacs 172 
residual mean square ................... 614 
residue 
biquadtatic: Jcncdoxvsesseuudesss 175 
of complex functions ............. 409 
GUAGE AIG: tei shelas die baru dsuceot tae a ee 28 
THEGTEM, 23 ys.dcostmrna ng ale eoatyareeraineee 302 
PESISLOTS A us sels techn 'Sisie aancus ndccnd ae addons 710 
TESOUTCE CONSITAINES oo. csccda cow oeraes 769 
resultant of polynomials ................. 73 
PECUMN TIME: 4555 dene yee dd ede enees bee bs 566 
revolution, paraboloid .................. 274 
THOMBUS: jesse uckiad Ges maveedaleedebacngeats Pay 
Riccati equation ..................- 189, 361 
RiCGlAGentHly’ 2. vaca un neaaeanedenensaes 383 
IRIGCLIONSOF ca suoxalndevagudee 381, 384, 387 
Richardson extrapolation ...... 646, 670, 680 
Riemann 
P PONCHON e55c5 Seas ceee 361 
—Lebesgue lemma ................ 497 
HY POUMESIS: ed ioeca sradndannde ealoans 20 
mapping theorem ................. 410 
removable singularity theorem ..... 409 
TONSOP accancdarioedoees 273, 384, 386 
zeta function ........... 20, 36, 51, 488 
Riemannian manifold ................... 382 
Riesz—Fischer theorems ............ 400, 402 
right 
ANGIE aa csndwle cane sie egies vee bs 425 
cancellation law ................5. 107 
CIPCUIAT CONE: f..656.0, 5.4.4.5 ocd ates eons 266 
circular cylinder 0c s.icecsnawess 265 
COSEl Ha d,cicamieessaaaamecemn sennee 107 
CYMMGEL seer ssh itd, cetate tee pds 265 
distributive law ................005 113 


divisOr:Of ZELO: wisic ns o4 ces ea veda ads 113 


rule 849 
right (continued) 
hand Wits) g5.5.dsieasaeiede mnndenaan ne 54 
hand Tule: ..2.. 00 aeestsieaeained digeanaia a oes 81 
handed. shah ieshedaans 249, 269 
HE oi gese dpi cauiaates xan’ 494 
matrix inverse .............00e eee ee 97 
spherical triangles ................ 224 
tangle? win cicecewae 33, 212, 213, 433 
HAND. ss iojn des winlcanwaranachieteyaagenn saat 113, 114 
fundamental theorem ............. 118 
homomorphism ................+. 118 
ISOMOTPHISM 4 vs. siebcadackswcearesga 118 
polynomial .........sssceecs eee ems 114 
PISK ANALYSIS js.s.ai.4 wiad caine dando rd endo did 783 
FISK MUNCHON xs ssh ocee ew aerne enurds araje sees 784 
Rodrigues formula ..................... 213 
Rogers—Ramanujan identities ............. 65 
Rolle’s the oremn®.. i060 cis iad eee 279 
Roman numerals: i. i.s.c9 ace cei es alee od ee 8 
Romberg integration ................... 670 
rook polynomials ...................00. 181 
root 
bracketing-methods ............... 649 
CHAPACHERISUC 3.55 ie ace saisaiece eeernsa ones 98 
MEAN SQUALE sie sinc nas eases 582 
multiplicity Of 9... ses eek cats 65 
OHI ave auaRurnae ining S8 a eaoawiees 10 
of complex numbers ......... 405, 406 
of polynomials ................-00- 70 
PMNS). 93:4-davadncanaes eae 131, 745 
SQUALC .  esaseisda vente see square roots 
HOSE ca wieigetatwenyaewieeeackees 49 
type of vertex of a graph .......... 13F 
TOO” PrAPD sda daa ceeian ge ea gee nes Hemedes 157 
VOCATION 6 ascas cos ceacesseewsavvanes 200, 252 
SOMECHON: 6.8 sein ged cane wvalenwes 252 
GIVENS® fics cadacaayneccnlommarms dares 86 
matrix representation ........... 85, 86 
Of POLY EONS s.cc cys cceeeaend ees 111 
POWISHE 15.2 stisnesatesed Side avueys neginiise wien aeacoese 244 
fOUNG=OfF CIPO 2.4 a ge veda ane hed arid andes 646 
round-robin tournament .................. 22 
POW 3 FAN 20.5 /55.5 5:0 jinn orice gyrase dea anaes ek 93 
TOW VECOL case doosuecesne some catereseeursoss 78, 83, 718 
Rubik’S:Cube: so ae:c0s00 cd cdigsbdietesbanaance 7 
UID PTODIE My 244 Sins ag ae ayatped eed ssid drole 550 
rule 
BAY eStwil2.c8 vita saat 4 536 
CHAI cereceuee Haeeeteue adeno eres 280 
COMPOSILE cciecnicinacemeomwiamlnnnas 669 
CPOMGN Sica wee esa weean ome oR 102 
PHOpi tals sss sitters wcongeesweenas 282 
LEIBNIZ 66 aa Sichdaweed gees enees 279 
mixed product ................04. 104 
OB TQ scctapredtisainasr edad eds aed Gee 752 
OF INFELENCE s.5:0csdee cen nda ee ened’ 762 


850 Runge-Kutta method 


Runge-Kutta method ................... 682 
PUNE OS alk araeeaduaakeak eae 602, 603, 606 
Russell's paradox. . sc csevocer sees des ate 13F 
salesman problem ................. 778, 780 
sample 
-mean Monte-Carlo method ....... 677 
density function .................. 580 
distribution function .............. 580 
mean algorithm .................. 678 
MOMENES” oy. osra etre Sertaewarramnacd de 582 
PONE wvedd en epesai ues daha tle 535 
PANGS asayrcttmcedase shane peino« a aecaius 582 
SIZE! scamenaveenes 585, 586, 620, 622 
SPaCO\ viaactieewed demmmnian wind 136, 535 
standard deviation ................ 581 
Varlances a yi sanaedeios teas ecdaey 582 
sampling 
|) 626 
SCAM AE ssc.j.sivig aden snaacgin se galssteiate elevate wae 78 
HOMOSCNEHEY sce sie sisccisis w 5558 wane be 399 
IMVATIANE ¢ ceteareusrwaiinnwncesie ee 378 
PLODUCE 3, had.reetdoctoeehinasenareier sade’ 80 
triple product: 2. ocscbPes adie ec ances 82 
SCAlETACON oaks ek ioe se udeaherewegerad 660 
scaled-column pivoting ................. 660 
Scalene (rangle: cistern cp tae aeons 213 
Scaling functions vsitatusitsesvicdsacodase 789 
scaling transformation .................. 207 
schoolgirl problem ..................... 180 
Schrédinger equation .............. 374, 717 
Schur decomposition ................... 100 
Schwartz inequality ............ 48, 295, 401 
SCLEW MOWON biices a neaueiae cava daa 252 
search, in combinatorial optimization ....777 
Secant function s:.4sscuseereseensenees 424 
secant: Method ic jie jaee ed neckaoe edn eee eas 650 
second 
fundamental form ............ 271,274 
kind integral equation ............. ate 
order equation ............... 351, 360 
SECONAS ss ricnascrdrenicdnaacnnneucteadrandtes 794 
SOClOF -sdizuce Sareitarontonapanggrageunss areas wes 238 
SCO fsbicSanncabntiasa are tdbtatereeemadoh marten es 569 
SCSMENE 4555 sta weia Vusehose an vcs sass sen ehass 238 
self-complementary graph .............. 157 
self-dual codec... .s.ccskctanrdnevsagasen 731 
semi 
SAKES 5045 sna ed Saduier anes aromas’ 220 
-cubic parabola .................-. 240 
-interquartile range ............... 582 
SMAJOM AXIS: ead nasheeds aed 235 
-perimeter ................04. 213,433 


SEMMPLOUP chee cg adie tome eabindaedes awed 106 


INDEX 

separability condition ................... 367 
separable kernel ....:4.55.cs0a6 oo sevew asa 375 
separable solutions ss. ceccidaesiwane eden 368 
separable Space .... 66... cee cece eee eees 397 
separation of variables ............. 356, 366 
SCQUENCE cd sccesisaedesine sacs minnene doe ede 394 
Barkers osiscsdenansd gece inaetednats 182 
DINALY: ss ertieg.sites diss Misi aide ge’ 182, 183 
bounded, Hint. ciccses sce eeeans 397 
Casoratiatl cocci cacevonasamaanewmss 185 
CAUCHY? disc's ed see Cauchy sequence 
COMVETZENCE oes eee cece eee 397 

GE Bruyn: eeris\casacice Serace ede dank 23 
COSTE. ic sseds ceeretearena scenes 154 

Pelta. i.e pcs cn caed see delta sequence 

EVEN) SilsiracSiss dean dic oaimede wane 501 
PCOMCUIC dacs. ds Lathageeeme gna site 69 
FOCNTA SE hcg Seaton et Dtaaercae ata tee 22 

Vininbs steess Gaeta Mena sh ca alee BOF 

Hit: POM: 06s da.cerghenee de eee ee a7 
linear independence .............. 185 

Odd Aces nig teanmas upgesan sagas 501 

OP INE SES os is caieas a piwerd a seston 21-22 
PSHOdIG: costsacen.was otecenesxe seu 182 
sequential probability ratio tests ......... 608 
SELICS. Sica dos hazed serene averenendeass 378, 424, 445 
algebraic functions ................ 59 
aAltemMatiNg ..acscaceed eeeareactaer's 47 
APMC C: on sundiesiss desea weer earn ates 52 
asymptotic .......; see asymptotic series 
biNOMial oaasnsecddesegiswsimeee ade 50 
Cardinia s...cisicda visited widte siaamreiey 499 
COMPONENE s)55.5 acest se etn acer 47 
CONVETRENCE: oe iiicenc siren aca ese pace 47 
DITCH o.ccs.s aioe tibes Seb ais Seis geese 51 
Fourier .........4..5 see Fourier series 
CCOMSUIC: ice saan eer aees 4, 52 

Ge BORYS' sés..c sobs samietaree cae Se 20 
ANMONIS odo vccccs uacnaene 47, 48, 55 
PNAS ort scaceonstpocnettaed betes 47, 59, 65 
inverse trigonometric functions ..... 61 
PAVETSION co. 55i5.6.4:5°% vines nee hee he ces 50 
TeaStan ges <..casnas dgneemannccnowens 53 
TLAUIENG .cin.csdsc condone eraany 408 
WCGOndtessisiia tiered aedace apesied 486 
logarithmic functions .............. 59 
MaClaUrity ssiess bac iiencuisle asus Shen 50 
MUILIPISs is aa ere aoe detatac 53 

OF INE REIS..ceesishaae ca kiws tee eee 21 

Of MMMBELS: 5,4: snaesesieesa dec s 47 
OPSTAallONs: ..!.60 ueesewn aes wks aa 64 
POWER 3:05. 5a murematnenee aeanae 47, 48, 50 
SYSIEMD: cichsicis-g aah ongmtawersn dieeen tai Si? 
WAVlOL sscci-nayd chaos cadets ne 50, 407 
LElESCOPING 5.3.5. cisdetssdss deweadntecemeiden s% 51 
trigonometric ............. 60, 61, 494 


INDEX 


series (continued) 


LY PES ancrs@anesdanuneameaarals 50, 52 
USELUD ci.cistewheitiwided sing Setaoing bene ans 56 
WAVCIEL subi ice aga thait ewes 793 
Serret—Frenet equations ................. 268 
SEFVICE MING: jae s.ni5cuh'e Hie Cae Mewanoadons 562 
SOUS. sdivinimnine de edaeere see nee sane ene eae 135 
Cardinality: ccs. es navdaiwves eeu 394 
CLOSED cj cearteahawuemenaanee cpudeda 396 
COMPACE oss cosines ke cea ee eee 396 
complement ................. 136, 396 
COMPIStE t.s/nesad decks cea steals 401 
countably infinite ................. 394 
CONSE! g.sitis's05es0s Soest daeamreen de 396 
CenuMeErable > sics:s. sacl sy tenes teas 394 
CifErenCe: 6 isc saan ee ieee ds 174 
distance function on .............. 396 
edge (graphs) ....5 66. ks eee ees 151 
SIMPLY. Messi toile ih Re ints ect ados 135 
AME: 5. dA wido is Vee ea mbna aandasiive 394 
IMAGE Skewes egeibss earietedeones 394 
independent (graphs) ............. 156 
MATE’ sists nga ds twice age snetaca 137 
INVEISEIMALS? igscocss sinasciaaryaats aes 394 
Folia (ChaOs) cixccescvecsescdacnce 741 
Mandelbrot (chaos) ............... 741 
MOASUDE!OL pss dase race dina brews 136 
MCHC ON 2s, icmiesincs cron cyan telels ais nels cine 396 
HUN Sc sep a dandaenn eae eee 135 
OPC, 2.4/ync ocaoeme Ande swreaunlaras 396 
orthonormal! 4.c5.sescees Ss ahaeeee 401 
partially ordered wai. hs cxsidcwccotes 138 
DOWER fossa horica Sis btaieie sta acasedaiceitery 136 
probability. sesiecescde ee sickens ss 136 
PTOMUCE Soc os saaeeedabaresiewsneane aa3 
TOLAUONS! s.dsasaswaudaswesn sagen 135 
Vertex: (Graphs)... icscsvulenrcamesae 151 
shadow: Price: o...i6 sue eedeioetestexces 7713 
Shanks transformation ................... 63 
Shannon coding theorem ................ 730 
Shannon sampling theorem ............. 499 
Shapley—Shubik power index ............ 801 
shift register sequence .................. 569 
shifted factotial cs. sccaxcaxeacaad vanes 16, 52 
SHOMESE VECIOE cosic db wewenevlatie laces 759 
shortest-path problem .................. 716 
DESY SEEM: i. Weschansstssdss Sa vaca see aie sl waclere Gare vase 794 
sigma conversion table ................. Sit 
signal processing ...............0.0.0005 785 
SISMINCANCS® 3. atieisinlees cen avainmn lace’ 623 
signum function ...............2.04- 90, 404 
similar edges of a graph ................ 157 
SiMMMAr MAI. ss Jade seakaseeomes eee 662 
similar vertices of a graph ............... sf 
SUMISTUIES nese eden dda sd danes 207,255 


solving linear equations 851 
simple 
SVENE wits na yarne sheeed weacase me iearesuiter 535 
AINCHON acess neceeweeteeesaeR 410 
STAD oi dacrien Minn seas ara tease pabieeateen 132 
PTOUP! xrchacenep atin Ructeaes 21, 107, 120 
INMLETESE wv. nansinnredawneseAs eulahelnesy 746 
root of polynomial ................. 70 
ZED O ces calers:deeden weatisneiten sop oaeacertjecdatailass 647 
simplex method ...............0.002 eee 771 
Simpson, numerical integration 668, 669, 674, 
675 
simulated annealing .................... TW 
sine 
—Gordon equation ................ 374 
HUNCHOM <c.2:hc:c5 anaes eonereeu tes 424 
INS BTML csenswauidechndeor mine pes wuneees 490 
LAW OF tn tupitetesadnexes 214, 226, 434 
SCHES al tucbud sacs see Fourier sine series 
HaANnSFOTM,. 0045 Sassen Seweideioted 518 
singleton bound 
block COdeS! 5.3 sien adasuas toads 733 
maximum distance separable code . 731 
singular 
integral equation ............. 333,377 
Kernel) ti.5 paste waeunsae news was eee B15 
MAWES cuties des cniren dang eaancdines 93 
value decomposition ............ 97, 99 
VANES! s.ccandacetcrnakotis antes dgemsuonsts 99 
SINSUIALICONVE: foc pauex cana ie keene 743 
SINSUIATILY 2255 weiter ante niinet aad 93 
ESSENtlal we aies idee aaeae segues seen 408 
ISOlated cideciseasenasdedur gee hed ea 408 
of complex functions ............. 408 
WEMOVADIE occ ccdsecad seed meeees 408 
RIVA ca0) it: 46:1 0) | ee ae 157 
size of sample ................-0085 620, 622 
Skew FENG) 555s csais ce -ace eagles aie are Seales Sun ate 114 
skew symmetric matrix .................. 85 
skew symmetric tensor ................. 380 
skew-Hermitian matrix ...............005 85 
SKEWNESS: s.ccatebiee Save heenzet seats ease oan 
slackness theorem .............00+0e0005 73 
SIOPC! snixadgws aren cne waned atin 209 
small order groups ..............0.e eee 121 
Snedecor’s F'-probability distribution .... 558 
snowflake, Koch ...............0000000e 247 
0) [5511016 | Ae a rr 283 
Solid MeChaMiGs 4c. y cca ce sanyecnwend es 722 
Solids, PIAOMIC: .occsegeeeesdeseeauacnus 262 
SOlids, VOIUME. i hicis cease saiee sie leweis 294 
solution 
feasible, linear programming ...... 769 
HOMOLENCOUS. seis ocic vance dees wees 350 
Particular sc. eee wes 350, 352, 374 
Solvable PrOUP wicisa cee ceric hens noe Hi 107 
solving linear equations ................. 659 


852 Sophie Germain prime 


Sophie Germain prime ................... 39 
source coding, English text .............. 133 
space 
Banach isthe is aniaiade tn aets 399 
COMPIEtE sac cee ta ian es el ba SOF 
CYCIS. scrianasnteeegas aes’ahen velco 154 
HBr nsec aca nsaXen salegnc siemens 401 
MGW: Ssiesivuone ales one asa eae 79, 396 
SAMPIS® scsacsusaesd ta cuwieie nsends 136 
Separadle aw scceweecncewag amemcns 397 
topological cacesicsis seas hieecs 396 
span property, binary sequences ......... 182 
spanning (graphs) ................. 152,158 


Spearman rank correlation coefficient 605, 644 
special 


ANGIES. Sivaoianee nanawavaensenane 437 
case of Polya’s theorem ........... 110 
C0701 13] £21 ic ea a er 14 
CURVES S:5.6.2y d04 ctdabid cadences 240 
MUMBETS,.5.4 vianetavesatac oe atnersane 13 
spectral decomposition ................. 100 
spectral fads! 06 nae uuso seme 100 
spectrum of a graph .................... 157 
Spectrum, PONE? v...5:sedea re enncsinnes 55 
Speed OPN SHE 3 fsb cia vanieietomeces hasan 800 
SPHELE: g.vicevreadivems tds datioed ia thd ceeds 221 
-packing bound .................. 733 
circumscribed ..............--0005 261 
SHAD is 539: 003) y:2edap des masaietarestayngisanges 158 
SUPPACE ALEA coisas aoa enanne anes 14 
VOIUINE sinks td iueatsees meee ke tae 14 
spherical 
USAC A vrss ie tonnes. pi hune aabis seta wipers 371 
CAD scpeesitsie send eeweiasabsegoes 223 
coordinates .................. 250, 391 
EXCESS) Sink icaie cre sunlesnacsao set ina ae 226 
PEOMEMY iss isvscsceleaeewwec wes 224 
HAMONICS ss.casieas ge seeteserewnas 457 
polar coordinates ................. 404 
POLY BOM sestis estado scasendnd daploatbieutide's 223 
SEOMCHE 5 auileoseseeoudo nate aces 224 
SUIMFACE AFCA: «scence ndandcone svinate 224 
(IANSIES! is iesecciea ewes oes canes 224, 225 
HIZONOMEHY 23.5 cuss neaeeeonsenes 224 
VOLUME, oscewsidcatasiicce eben 223, 224 
ZONE; -seinensie hued pawn de bean eae 224 
SPIPAN wrirtotetstek Sneath asda anlteoaunre arent 246 
Archimedéati’ 304.0 aceite ebaceais 246 
COMM.) acon ao ee Me baeaes taeeaeae 246 
LO PAHANG osc iisecwessca sacra wie 246 
spirograph curves ...........0..0eeee aes 244 
Spiess jeaugvewenenece esa we 655, 656, 658 
sporadic finite simple groups ............ 120 
SPLCA! fcc strsceeaye sea anton cornea south tin ouch te 431 


INDEX 
square 
CONUMEETS: pic cece senses wees are Fis) 
Graph! oc sices castes beds eevee esis 160 
TAU Scand nae 4 Sa annstnaresseacd 179 
MAIC 0s de ated Garten gathins sth doe ah 782 
MAUI an. cileaanneRamnanemeavaneines 83 
MIGUETS 5,0.ca tins ae sGa ead arenes 799 
operation on graphs ............... 159 
MOOUS) sins: sie aid doh fa- odes ane anaacacn veils 14, 16 
SQUATES eons ue i te puro aiueNe ee 21, 219, 543 
coloring the corners .............. 112 
CVCISANGER: isis the baste cee acerca 112 
SUMS OF 2 vee sdeboes Seecuderda 22, a5 
SUMS OF 4. sc seasviceiioedartnene gas 35 
StADILY si.5 es hap biome tare spaces a aatiens 363 
stamps, folding, number of ways .......... 22 
standard 
PEVIAHON hai aa ueG a bake 537, 581 
Sstimator sa..0e ae iasges ves ak 585 
IPOD ygeh.c iia pace dade andar tie bayer oiers 609 
FON: si ntacesastaebednwnenew eens 7710 
STALE VECON a iackc ican aca sieoga ion variate aa 734 
statements ......... see propositional calculus 
SIAM ONALY: ai. aras date wuie see eee he 565, 786 
distributions. 6... ceded eas iene 566 
PDAS C6 ahchissk hss eet artewtaniern sate Suatton.giekees 304 
statistical mechanics .................00- 723 
statistically independent events .......... 536 
SLAUSUICS .sn-stha.satnes donner ioe emenccmien 582 
CESCHPIVE’ a vssacws see ceneeeed in oa 580 
CSHIMALGES eis ce ecreexc ea veenees 582 
jointly sufficient: <0..00300¢ eewna se 584 
SUMICIGNE ivi gc vituddaasiaeds 584 
steepest-descent method ................ 666 
Steiner triple system ................0... 180 
Step TUNCHON scsi eas case ave 'eenes 303, 404 
StSTAMIAN) syiisssag acing sages du isrewaientaens 794 
Stirling 
cycle numbers ..............- 146, 150 
first kind number ................. 146 
formula for n! ................ 16, 479 
formula, interpolation ............. 653 
second kind number ..... 147, 167, 564 
subset numbers ..... 140, 145, 147, 149 
stochastic differential equations ......... 359 
Stokes theorem ..................45 290, 300 
Strat ght INS paisa ccsd ne das eu ea see ene dee 209 
Strassen algorithm ...................... 89 
SIPALEBY” oe isin aca stan scene ewe nscondes 754, 756 
strong duality theorem .................. 71733 
strong probable prime ................... 39 
StrOphOId oa. wxcwse seca wicsadagieneoemens 241 
sub-factorials ........... 00. eee e eee eee ee 144 
SUD=MAWIK: 65 ices BAe aot cua ce ndeare sy 87, 101 
subdivision of a graph ................2. 158 


SUDBTAPH. cassece se cinecee sede mdvens seen 158 


INDEX 


SUBPTOUP sissies. cs0dace hun ayne eauardeate omelets 107 
CY CHC rsp sisrs ens vps Sone ane gee aac 107 
normal 3 ciavviwdaww chee 107, 108, 118 

SUDTING Gia na cricnet sonst ne acute 113 

subsets 
Heine—Borel theorem ............. aon 
OF Pea ING ast eeesethassateenns 24 

SUDSPACE csalagts cams vstermatiuunnlsaadiaeatan 96 

BUDSTILUTION aia cewadeas sa daacasens 194, 296 

subtraction 
of complex numbers .............. 405 
of hexadecimal numbers ........... 12 
OF MAWHICES osouikedaroersnaaracaean 88 
OE VECIOIS: dvncis ca waoe epee ddniumre 79 

sufficient statistic ................. 0 eee 584 

sum of divisors Of 2 ...........0e eee eee 22 

sum of squares (Lagrange’s theorem) ...... 35 

summability methods .................... 64 

summation 
ADL jenianagetee vers paeideeuradera 64 
CESAEG: scckuxvartas oh4008 ewaaee 54, 64 
CONVENTION eie:sis ead wa sie k oielowne scataviene 378 
HORMONE jeccGudiswascn des asaged 63, 499 
Poisson formula: i... 0s.cc5-c80 6 oie ee 63 
RaManWjan sje ugeccinae sce wees e 64 

(1110 01 ee ae 429, 431, 442 
DY Parts ic. co di'e Sa oe de ale See ate 48 
combinatorial .................000. 32 
Euler—MacLaurin ................ 688 
INTER OES scape dutcansn devas scene honed 3 
INtEHlOr ANGlES iss Gsidnacdeeeest ae 433 
PAVOIVINE 70 edtinatactind ba darsineen en's 20 
OF 2/SQUATES: 6.b5c5 Gahan wie swith 22,35 
OF A SQUATES ociecdines Ra deielssarwees 35 
Of ATEUMENS 45.66 oes ent aee ee erases 445 
of negative powers ...............4- 20 
OF Parts ahaa Seaweed see partitions 
of powers of integers ............... 19 
Pattlall sic cacueden esta vecantes Sa 47 
random variables ................- 544 

supergraph of a graph .................. 158 

superposition principle ................. 185 

supremum of a subset ................0. 395 

SUMPACS poise sas asaeiciens: pes oman dsacscemuerecateress 270 
ANCA icinnie er cqrouss aenaierngarem ate aed 294 
area Of Sphere: 43. venss dee ee sis 14, 224 
ANUS STANLY, 35 vse Sata not va cvan ares Wests 300 
Of revolution oo. c.s chai coe 219, 294 
theory, fundamental theorem ...... 273 

surjective function ..................00. 394 

symbol, Pochhammer ..................05 16 

SYMBONCIOSIC Basis assist ewes tenes 761 

symmetric 
Channel $5 i ciwcecacutaavetincencns 730 
CESIGNS: sith tadinaidadtaas 173, 180 


ifPETENGE. 'cia5 4 Sica e.dianndermenmaeuies 136 


tables 853 
symmetric (continued) 
FUNCHONS »-i:5..hi cad needs ewan eared 71 
Graph -cvciccsnaskiwesiuns gs nesensis 158 
PEOUP characte estate 108, 109, 128 
etme 5.:i24 eyy satan dataeuang esas 375 
WMAGIK nati Aeeneacuviasnsas 85, 663, 664 
PAE eco sels Mamacea leans din cgee deena 380 
POA ON 4 i.e sparen seutv adam wie 393 
representation of polynomials ....... 76 
(ENSOF edi vieadaaaertegencoegseeee 380 
symmetries 
of a metric or distance function ....396 
OF SPACE sas ntnne stn dee sele Sead ied 252 
Of the plane’ cc 5 56068 save nea ads 200, 202 
of trigonometric functions ......... 426 
syndrome (codes) ............00eee eee ee 731 
synthetic GivisiOn: Vissi dunos dace aeend oes 651 
SYSUEMS. 3c4\cas- ia aadeiawadaeaastn s 714 
CAPACHY add. Modi eeoe esses 562 
non-linear equations .............. 665 
Of CONETUENCES: b..20.dcseasegaiemenss 29 
of differential equations ........... 684 
of linear equations ................. 94 
KECIPIOCAL. ssiscueuwe.c xoinwas wemesae sted 82 
t-distribution ..................005 559, 631 
1/6 oh) (24 1 gaa aaa 172 
tables 
F-distribution ............... 633-638 
x?-distribution .............0..00. 632 
t-distribution ..................00- 631 
ANOVAS es iia 'iea cana tata nae 619 
CHAPACIELS sssiasatearnuacnrs wee pteinrerd pais 128 
COMbINALIONS® veces aces ieseeas 149 
conformal mappings .............. 411 
CONMUNZENCY occ ccd ese eens 604, 623 
coordinate systems operations ..... 389 
cosine transform ...............4- Si; 
cyclotomic polynomials ............ ae 
definite integrals ............. 343-349 
Eulerian graphs .................. 162 
exponential function .............. 450 
factorizations of 7" —1 .......... 132 
FiGldSy aises esce pn seaeee la ees 126, 127 
Fourier 
cosine transform ............... ai9 
sine transform ................. 518 
transform 2.6 .icsveuie sees 519-522 
gamma function .................. 480 
Green’s function ................. 359 
PTOUPS: os.c ps ecareciea ane goles eos 119-121 
Gudermannian ................... 450 
Hamiltonian graphs ............... 162 
Hilbert transform ................. 523 


854 tables 


tables (continued) 


hyperbolic functions .............. 450 
indefinite integrals ........... 305-342 
TNGICES is ciyssih a Gatarsinnceiyn hacen auegs 128 
integral transforms ...... 493, 517-531 
MNS PTAIS: o5.0o5.ce hes Maweda wen’ 304-349 
Laplace transform ........... 524-530 
logarithmic functions ............. 450 
Mellin transform ................. 530 
of transformations ................ 416 
PCTMUtAHONS Liv ciwiewiceeeevecnds 150 
polynomials, irreducible .......... 130 
polynomials, primitive monic ...... 130 
power residues .............. 128, 129 
PLIMULLVE TOOTS? 6 oi cee is bb ree ane 131 
probability’. 55..bs5scna0ed excenweawe 628 
TUNS ESE «2 cies ce cedwesdadensan e ake 606 
sine transform .................06- Sty 
Stirling cycle numbers ............ 150 
Stirling subset numbers ........... 149 
trigonometric functions ....... 438, 439 
tabw S@arch'\\ 2c, aysiedslesctiadatetaecans dares 7718 
tangent 
AUNCHON acct cesses eheermesiet 424 
WN estiivecigas sete sees eee ws 268 
PLANS seh tet sa tntedasedibetns aants 271 
WECIOE .ciee sh des Oe oo bas wae 268, 385 
fantOlO gies: osc cab ad neneaiarnes ah eu om 762 
Taylor isis icj:s ees cnas atna dona om eas eastawesiacts xii 
MIGHNONS: ocd deav ensued enaown 681, 682 
SELES cacnadcneradeveguniwawes 50, 407 
telegraph equation ..................... 374 
telescoping Senes) 164s snadun satiated waae at 
[3 00) 0] 2) 1011 ee eee 794, 795 
LENSOF toss cteida sic ee ated ens ves sawoesed 378 
ACAI ON si: 0.5. 5-fsys ace. orcad eae daskatee 379 
CaMmesian) 0% san one sateen evsedease 385 
CONTACHON: (54,.655.094%so Selassie 379 
CUPVAlUTe 2... cece eee eeeeee 381, 383 
differentiation .................... 380 
Einstein ...............00000- 384, 387 
TiGViR Civil o.5-<.055 oe cbinne Sead nas 385 
MGUIC. ws orderachaeneokeedaas 368, 382 
multiplication ................0.0. 379 
OPELAllONS: i siscsiccendvas de peusun se 379 
PIOdUCl 34 cc ncedecadeu de dealin Sinawe 104 
RICCI? oh said see wake eed 381, 384, 387 
Riemann 03. essen. 273, 384, 386 
SHESS-ENELZY caccecen ced cvwdee won 709 
SYMMECHIC” 5:26 cid anise smsancasel 380 
VORSION 4 at ntin sanaud aonwaees 381, 383 
LEME MAD: «iiss icas ogeucciaswanesiotes ess 740 
ternary Golay:Code ioc o:sa sence singetinn se o32 
test 
alternating series .................. 49 


CHIHSQUATS «oie ocs.ceonoenbone da 603, 604 


INDEX 


test (continued) 


COMPANSON siaucvssnahenynnarrecwes 49 
convergence and divergence ........ 49 
GIStbULION: 2.04 doses saevaleds Garces 604 
CIVISIDINEY® o9es 5:0 ite Soa eek eet sles a 
GAUSS) aac.d a mANe ta Rides meets anata 49 
Hypothesis: nasasaasdoseeees cheese at 606 
INEST Al as o's dtsrewsacinlcpeeres sagen 49 
Kolmogorov-Smirnov ............ 604 
HM. oss vgs waves nwee eda wae sets 49 
Mann-—Whitney—Wilcoxon ... 600, 601, 
605 
mean .............. 595, 596, 598-600 
median ............ 596, 597, 600, 601 
POWEE aac rngdind sich smataimeae emacs 582 
GONO AGcc sa derendnusemaardenee? 49, 608 
WOOD: cg sien ce segue neon nek us 49 
PUES we) Sien ted oe ad 602, 603, 606 
SISMMIGANCE 5. 205 eh hibeass funy ea 623 
StAHSHE =. 2.825 sn oaauadmedaanntache 582 
WAYIANCE sc ccacecvneeuaseecee 597, 602 
tettahedtON oskkovwlecaausas sans 261, 262, 264 
COLOEMG: 6 i icin shank aceiadeapen ates sisann dis 111 
VOIUME 6. 56c6 cee deeesae wee 261, 262 
(ELLIS: vanaticdandaeiee baw cearse SORE ak ota s 782 
TEXUCOGINE et sc divsinhd vsesed he grace theses Shear es 733 
theorems 
Ascoli-Arzela .............000005 399 
automorphism group .............. 167 
Bolzano—Weierstrass ............. 37 
Brooks’ (graphs) ‘s:.\i0sces.auueey es 163 
Bruck—Ryser—Chowla ............ 173 
Buckingham pi ................... 797 
Casorati—Weierstrass ............. 409 
Cauchy—Goursat integral .......... 302 
Cay SY a:sietasurisiaieacearstnnase Mista aren 118 
Cayley—Hamilton .................. 98 
central limit 2 esse ccs aae eu wencases 538 
CONE “cos camenntcwnkonneweeune wars 215 
Chinese remainder ................. 29 
CODING: 1%... duudan dame aageaeiena. 730 
contraction mapping .............. 398 
Courant—Fischer minimax ......... 102 
IDEMOIVIE! is x: scs esha aca oatawars 10, 405 
GEriVAtIVES isc cde e ad ese oe dicacens 279 
Dirac (staphs)* icc cdvgsdenetontins 162 
DitiGhlet 6.435.635.) sekacdiceNisasacs ay 
GIVETRENCE: odie cic ya Ghd ace 300, 301 
CUALIEY: aac esa sae Saeprenaladeieanaes 73 
Euler (multigraphs) ............... 162 
PGi atl sie'scanesra acres ace 29, 32, 38, 763 
Fermat-Euler sca. snesseamen evaows 29 
fixed Point 1.25: 65 .5.008 ve 398, 647 
four-color ...............005. 163, 166 
Frobenius—Perron ................ 102 
PRUCHE Sas covicea Woes sea tend eens 167 


INDEX 


theorems (continued) 
fundamental see fundamental, theorems 


GaUSs! s.wisetd cusegaen latent ones 46 
theorema egregium ............ 273 
Gerschgorin circle ................ 102 
GICCN'S vce caeccescnswas dens 300, 301 
Hardy siccscseseederieednnavedsades 510 
Havel-Hakimi ................... 166 
Heawood map coloring ........... 165 
Heine-Borel .................-05- 397 
intermediate value ................ 279 
INVERSION tis ich catgut ees aacawedied 498 
Kirchhoff matrix-tree ............. 163 
KG6nig’s (graphs) ................. 169 
Kuratowski’s (graphs) ............ 166 
Lagrange (sum of squares) ......... 35 
Diahite ctsas 3 cd teiotawneesaya geen 235 
LAGUVINE 2a 4acu sae swiaees & 406, 701 
Lucas-Lebmer aie ik eect eevee é 38 
MAMAS ys scs cede ceeds fades 169 
Mean Values... 0/4 siceeuevandevaas aa 279 
Menelaus. sissies dann aedaneaie te 215 
Men BCT, scii-acstctat cir acess eaten s 162 
MUNIN AK 5 Sen yorunennareeaay tans 102 
Nash—Williams arboricity ......... 163 
Ore’s (Graphs). .o sc swisrssawewedces 162 
Pappus—Guldinus ................. 219 
POlYal noni cchaceceeunedeater eons 110 
polynomial approximation ........ 399 
primes in arithmetic progressions ... 37 
probability’ s3 sesoe8 sete. d cea ceas 536 
Pythagorean .......... 3, 429, 432, 433 
queueing theory .................. 563 
Ramsey’s (graphs) ................ 163 
removable singularity ............. 409 
POSIMUS? jaisii cm: scactinlacn a siiee aon satan aiate 302 
RICMAON fascia cwcadavacewsva 409, 410 
Riesz—Fischer .............. 400, 402 
RONE'S esccwaaosvousvesascunones 279 
SHANNON .. sacccaanccdaaeaa ey 499, 730 
SIACKNESS: ou.as ceewineshasvesuucwers 773 
StOKES canna ncdeuiadoesaecued 290, 300 
Szekeres—Wilf (graphs) ........... 163 
Thompson-Feit .................. 107 
Turan (Graphs) sicccecc cow eeddas ven 163 
unnamed ............... 397, 399, 402 
Vizing’s (graphs) ................. 163 
WEIEISUASS! occa cease been a 65, 399 
Wilson’s (congruences) ............ 29 
thermodynamics ...............0.e0e0ee 724 
thickness of a graph ............... 158, 165 
thin'mterval vccciaacccnesietemecaeres 24 
UNE deere eae ae eM ee aes Sale 794 
between failures .................. 578 
CO: Faure: aii ie adedhees edteakaeaents 578 
UNUS: ¢ casriceaarsianmemacnespatiaass 797 


transition 855 
TOGPIiZMAHIK: aes cade. ema nseengiars 85 
LOPOlOBY, .aioncacndence gecacn nt copa awes 396 
LORQUC! vsidcwine tds wed eddiona bei salesiewins 696 
WORST sissy Seah ica odd wh ace beaice deaing Sosy bea sense 268 
1ONSOD Giada and aedaatas 381, 383 
NOW: oyca ie deentundecGe edhe cnsctwan 219 
totient function ................... 21, 29, 46 
tournament, round-robin ................. 22 
HACE orgie Ss shstavviiels ys macteae are sianessha wees 91, 93, 182 
trad, ina Staph: iis Save cnadee soutien aes 158 
transcendental numbers .................-. 9 
transfer TUNCHON «04 4xcacinndataaces ededes 734 
transform ..................05 494, see tables 
LE ics sitet iSiandicn as nesta cont Seabiei eon a 187, 512 
AGL es isdsccacaeaance steniye wate wae 493 
CANONICAL! 5:5. .iciewonmepa sia danas 516 
COSINE: 402s sew eabeanede wns S17 
discrete Fourier ...............0.. 500 
fast: Fourier 0). 0s chunk Go ban 502 
TMG apne ced ce tarad mind oie eens ott 
Fourier .......... see Fourier transform 
MOSNE visuin eevee aawns 499, 519 
multidimensional ......... 502, 522 
SING petcnda Gad eatevaawsa ned 499, 518 
Presnell) Gccoussse Geant sesseesee es 516 
Hankel cess asd akeis 493, 503, 522 
Hartley? ai..5 2s dceteien sa tse o4las 493, 504 
ATCT is ad soot ett does 493, 505, 523 
Laplace 56, 357, 493, 508, 516, 525, 563 
Mellitt 0345s eatsnasantes 493, 512, 530 
multidimensional ............ 502, 522 
SING: 5 i sacdgcwtadweeriwivaaeheww cans 517 
Se 2) | Ga ea 790, 793 
transformations ................65. 195, 196 
AMINE: edstanadotns vhareascane 207, 256 
Baker (chaos) .......000ssseeasues 740 
DIHNGAR o:.hd.cstescusutes aacasiemdatea se 410 
CONSTI S s.cacxeu sie wesdasieeut Fi2 
Coordinate sg 5.6 eeacsdiswasceees 378 
Houscholdér’ s-45.0csisiss ctsan vee ae 87 
linear fractional .................. 410 
TEOPEMZ, 93.52.cure ca ot apuied Seay ess aen 721 
MODIUS! s:cspsoucentuaws ota oon conden 411 
non-proportional scaling .......... 256 
of complex functions ............. 410 
OF Mntestals:. susiit sisy sinclar ws 207 
£0) ba ed B) Sh eee a ee oer 364 
PUOJSCHIVE caw Sio 0s Save aG ve 208, 256 
proportional scaling .......... 207, 255 
TOUAUION *5.s5a cssiesisna Gu sietoagre ne sand ences 253 
SHANKS! <:es5 2 tas matenseieea ante sina’ 63 
HWANSIAUION ss i.se5 6 ois.cec sania siete giengee eee 293 
transition 
PUNCH OME 5s. eee eishisectss acteaceeash ie sndewed © 565 
HIGHIK bl sive Phecdawtosas 565, 730 


probabilities, and channel capacity .729 


856 transitive relation 


transitive relation .................. 138, 393 
transitivity’ asdiencuaie netsh hence 762 
translation ................005. 187, 200, 252 
PANS POSE? isa jaca cae Sos. aceidnn aReateMoanenteiasee 78, 84 
(CrANSPOSINONS :<.6:03. 6515.24 Mhis tated tek Yew 108 
tLANSVETSCIAKIS 2 eis iedcawenedeaenen.oaee 231 
trAPEZOld ‘serctecdindtacreanhemsenencsa> 217 
trapezoidal tle: oi. weessineue sean aan 668 
traveling salesman problem ......... 778, 780 
trees 
CHASTAINS bes.c5 d.svcidietse eteoodsd aes 170-171 
TAD nsséce beth hus aesde nye a nena deed 158, 160 
isomorphism classes of ........... 170 
labeled! Saisie ans chic Saeed eomnes 167 
PLOPEIULES: ce. 0:5 son anarenacnaten sews 163 
POOLEY 3:5 -6.65 occ gedone ahaa tecaaus 22 
SPANNING seed Ste wahines stdaaasies 158 
triangles ............ 112, 211, 214, 215, 435 
ACUTE cy. 55 bentachiars Gavooeiggs beh aaueedeasiones 212 
ANIMAS: 2.52 ody var ak Gaeaoatilemse’ 213 
ATCA. ocr ven rea rauaineled seeaiambnaneed 434 
Cholesky «.i0:c2.ciissessgswsseencde's 99 
coloring the corners .............. 112 
UU Atel: fc. os teecesinmasnarnsee 213 
General! sac eweadigseenek awe ee 433 
STAD a's te Ssrseets ae Sabena Msaeelace lets 160 
MEQUALILY .. ccsuiscre nc ved swe 79, 396, 399 
ISOSCEIES' §....262e5 2 bins edenea rene dace 213 
MMSCIANE ac, sraresivctasacsiecnacsite aye anatase 213 
ODMSE: 5: hncionciind indi omacancs we 212 
PASCAll tec atsottia tals che weees Sablaeteceee 142 
PlaNal sw scateskewseee scares 433 
POLAR: 2 it bat Senedd iets dee 225 
PANGOM: nsdn cdoedaensee eacwavaeae 544 
TIGNE, ospeioic hin delese band 33, 212, 213,433 
SCALING: 6:55:05 sa aioe eG4arew eas 213 
SOMHOD. sis sccusswaasee enna nes 435 
spherical suc. gs ssseceensaay 224, 225 
three Sides. cscs ceckes aoe ae vs 435 
two sides and angle .......... 435, 436 
triangular matrix .................0005 85, 99 
Tricomi equation ..................0.00. 374 
tridiagonal matrix ................... 85, 662 
trigonometric functions .... 60, 424, 426, 427 
and exponentials ................- 428 
difference: seecisnleedseces woe eed 429 
RIVETS: yb da Sakae ad ad gueaey 61, 441 
multiple angles ...........6..eeees 430 
POWELS ssc cech cat iccadinnnanesease 431 
DPIOGUCES s.carasiiacrawsaitemetiean ee 429 
SUM fo 5:50 diadhsrnielecaranastea adore eka 429, 431 
SYMMEMIES) <sccceucdadyass asi okere ees 426 
tables wis caweiwie gaens saw ew aaes 438, 439 
trigonometric series ................ 401, 494 
trigonometry, rational .................. 431 


trihedron, moving .................-000- 267 


INDEX 
trillion; denned i... i sean cad nae ia ties 6 
trimined Mean’... 5: sc esadads ae cwancas 581 
triple’ products:.s.cis4ch0tsavekevatwdoss 65, 82 
trisectian atigles i... jc ceive aves 242, 248 
trivial STAPH ys. cw rwied wena Ve ed tan et 158 
truncated pyramid ...... 0.206.605.6050 eens 261 
truth Tables: o0:cescesegleescned snes eee eins 761 
EWI POIME 4435.2 wow ila ae 3, 39 
two- 
factor ANOVA .............. 615, 617 
FOTN! peer Mh anesntithoraka ries 289 
Person GAMES .... 6... cc eee e ewes 754 
sample Kolmogorov-Smimov ..... 643 
valued autocorrelation ............ 183 
types-of NUMBERS! sf. bc ece cca eee eacmanenes 9 
LY PES OF SEMES# 5c: 235 cidond smsls ye bares eaaniee 50 
Umbilical POit: 33.004 .ces dow es area soda 271 
unbiased estimator ..................02. 584 
uncertainty principle ................... 498 
UNnderdaMpIiNg ists caguctaniaasnwnweses 355 
undetermined system .................... 94 
uniform 
convergence ............ 398, 498, 499 
probability distribution ....... 553, 559 
uniformly 
continuous function .............. 398 
minimum variance unbiased estimator 
584 
unimodularity property ................. 775 
union, of elements ..................... 396 
union, operation on graphs .............. 159 
unique factorization domain ............. 113 
UMIQUENESS fs sch isdsteesited acu amaiteaces 363 
generating function ............... 187 
solution to difference equation ..... 184 
unit 
binormal vector .................. 268 
CONS) i Aosta vena onenee iy niauhes 204 
impulse AUNCHON: -is...05e's0 Selatan’ 403 
ANA TING latins Siavem arenes beet bent 4 113 
normal vector ............... 271, 274 
step function ................ 404, 580 
tangent VeCtOr v2 .ccs ee siveeneceecs 268 
VECLOL :.sy5irsssheatecararaacediiarers a aceon a's 80 
MMtAEY MatK saisicenge dou a eaten s 85 
units 
English, ccc. cesciueaheeeteokanes Od 
TIL OPY se ssecsrseirrasraralaieiaantlensse sh aadet tex 729 
IMCWIG ais, SaGiasiale os: 4b bam ang reese acdiee 799 
of physical quantities ............. 7ST 
UMILY. ss dacance depended euniiresan ann ars 113 
univalent function ...................00. 394 
universal QUANTIAER 4 occ ccc bau eee seasises 763 


INDEX 


UNIVErSal Sets. sisciraasdsneamaaeas sees 136 
NIVEL EO iai5:s ise sieyndesonennne doe doa wa aaare oes 135 
unlabeled ‘raphy csentsassctsiarsdvaeos se 156 
unreliabilities, law of .................06 ory 
upper 
bandwidth) .i0/.6 000 ese aececeecondes 85 
DOUNG: measreatetinn re tases 395, 592, 594 
COMMON TMI 5 iis :cissse% ack sais wae’ 573 
Hessenberg matrix ................. 86 
triangular matrix ............... 85, 99 
WRT OF Crbatan 2c! sek crac iaddeakacw ebony xii 
values, critical ..cc.cc¢ce00eeeveusearend 628 
Vandermonde convolution .............. 142 
Vandermonde matrix ................0005 86 
WAP S she hc ate aha aes a Sond raed a 537, 540 
ANALYSIS: a. 6i6:5.6 wa sans Scie Gas eeedren 613 
WOUNAS 22.0 pcisi PAicadod ddwadiauner Many 586 
confidence interval ............... 589 
CSHIMALOT eeaigacigcsnes seadss vases 585 
SAMPIE siccseeewss ese tueneswas 582 
TEST oe oak aineanahwanaaeies 597, 602 
variation of parameters ............. 187, 358 
variational principles ................... 303 
vectors 
ACGION 06h. a ss033: age acewreareu ned ed oe 719 
AISCDEA :i.c's 5c bern a nara eaae 78, 79 
AVETAQES!). ta side niwemters weaned. 541 
CALCUIUS OF 535 ssi dea on ieee doe 283 
COMM Shop edoiua tks 78, 83, 84, 718 
CUPVANES: 0.55660 tees thwren eee eaes 267 
COL. cuted eenahitawies tanadcese tans 154 
GEriVALIVES: cise vse Gs saeewanieee ace 284 
CIVETRENCE: eecgisearenc sasheanci scorns 384 
Laplacian ie cuied sesea ex eohwwies 389 
HE PALIVE! 3 side deirdre aaa casted 78 
WOM asa. Hee dnciuidaaatadasé bee ok 719 
MOMMA! oc cnteis cavhn hie wnhlowaas $1,271 
MU  vcS.0 deg Bodie eens cone alee sor 83, 382 
Observable: 3.4:c0dcacleosrde ewes 734 
OPETAlON weirs ses lowane iad 103 
orthogonal cc siveseeseerasacweee sce 79 
orthonoriial! 4 j9 cecaxaos en sades den 719 
parallel) 425.06 Hees Wa eNO a3 78 
physical: 605.26 ecsde heed nedacans 78 
PROdUCl 62 cis ces ccenescrveieraraera's 81 
representation .................00. 350 
TOW 5, 4-4sarscactepetietacesa sieaaes 78, 83, 84, 718 
SHOFESE wesc wienssewieweadcegan naa one 759 
SPACES ecueeyedemesdaareseeweens 309 
SEATS: ced ccee Ved aad Sie wa oan 734 
LANBENE soc e eGanes Kerem ee vaewees 385 
Taylor series £08 .3.s:iv.cc see see eneves 50 
triple product ois ce nscks odeena dees 82 


TAME pes ihses hace Soa deca acne ncn 80, 271, 274 


Weierstrass theorem 857 


velocity ....694, 696, 697, 704, 708, 721-723 


MUIIES reise tnasdtn ae cunsssrecemaien ca hiaceaneee 797 
Venn diagrams iise sce. as lb eeeeie tat aans 137 
METER, fais aictds acini venient pane pannatetn elon 211 
central, of a graph ................ 153 
COVER focigcnseseetentetory aeueees 163 
CUL ihr Site cedendeac aioe gamed 154 
degree (graphs) .............. 154, 166 
CN: sibiy aca ase lastinrsenlene camels tats 155 
STAPH). vreascivvince nswuow geen ewes 151 
ASOlateH hie dais Besvetoe dha Mawadhatadnrs 156 
set: (Graphs). isc desis daceawiores 151 
SUMMATIY? sic onde ndnnGiolengacnie owas ine 157 
space of a graph .................. 158 
symmetric graph ................. 158 
Vizing’s theorem (graphs) ............... 163 
Volterra integral equation ........... 333,377 
volume 
CONST a Sty tee us ttae cat oreo taun Santee 266 
CULE cain de agmaxmatwaerchmaneean, 248 
ellipsoid ....2pc2secacereracewanenes 220 
PUSHIN iss sianaeagneagie ide eaw ene 267 
Of revolUtION 4. .s ci escigecee teens 294 
PUSH. 3. sincere acoueseteuoures 261 
PTA susckvcciueoeswecenswasd 261 
regular polyhedra ................. 264 
Sphere... noeesaicepdnsaneenea 14, 224 
spherical zone ............0.20000- 224 
surface of revolution .............. 219 
tetrahedron ccs. ccaccece ow eves 261, 262 
TORUS ss, gic sedicia auainie betaweneson 219 
truncated pyramid ................ 261 
UNIS. ey belated abe saaheavens 797 
voting power .................0.008 801-803 
waiting problem ....................0.. 252 
Walk 1 Bap ccs csineccncanidis ead sain 158 
wallpaper groups ....................00. 202 
Walsh function... 050000 ees edesbeeaes 293 
wave equation ............ 365, 371, 374, 685 
WAVE MUNCHONS Heiiciiad Sais cus eek Lee tae a he 489 
WAVEIEIS ccc da dace cea ekoeee 788, 791, 793 
Daubechies :is.s05 sae scavueoaesedes 790 
AAR as achie outed avandia naiae rac esis 789 
tANSTONIG boca ud daneeeaced 790, 793 
weak duality theorem ................... rie 
Weather <5 s.cousanoisuousa keen seuekeaeane 783 
Weddle s tule? ssc. csuxitosipnecmeectasewes 668 
WEEE PLOCUCE 4 sci ccicersseataccatsn cmmieibenacs 288 
Weibull distribution ................ 559, 578 
Weierstrass elliptic function ............. 492 
Weierstrass theorem ....... 65, 397, 399, 409 


858 weight 


weight 
ASSIPNIMENE ose. s:.cseecddze osmie ophrara haw 110 
block COdiNG screens geeendteien 730 
OF ATEHSOL 5 c:i65 hanna cd eeadenaNes 379 
weighted 
MCAD ‘ysis discmnher dae waar die easny ne 581 
Monte-Carlo integration .......... 678 
sum of squares ...............0.00. 83 
well-conditioned .................0.e0005 94 
well-posed initial value problem ......... 681 
well-posedness ...................00008 363 
WHITE NOISE: sesii.dd se Sasngurees- cee tags bores 785 
Wilf—Zeilberger algorithm ............... 51 
WilSOD PHIM: isis.orecnsesieindds sheceneeees 39 
Wilson’s theorem viiivcccs een ecee ene cues 29 
WINKOWINS: 5. snad na encom wba dunia sane 785 
witch of Agnesi ................... 240, 241 
Wronshtan cess ciactsccisn tannin tea eade 358 
@ANtELcEpl: o dackccaaeces ew Gesew ores Re 209 
MFINLENCEPE: Avene dic ordeciaas das Re eR ee oe 209 
Yarborough... c¢..0gosh cupsemeiiaeces ene 548 
Z-tramsform ........ 0c eee ee eee 187, 512 
ZEMIN ¢ sscatersriss eckbacsuindead ase 8 toon Peigamacew aes 250 
Zernike polynomials ................... 456 
zero 
“SUM PAMEC 6 sc ge soi vase sk oe 754, 755 
MAUIK cig uicdiciasw antes te cemanae 83 
of Bessel functions ............... 464 
of complex function .............. 408 
SUING phase AS Kathy st clas ing di 647 
meta TUNCtiOn 6. csc cess 20, 36, 51, 488 


INDEX 


